Welcome to the Debezium community newsletter in which we share all things CDC related including blog posts, group discussions, as well as StackOverflow questions that are relevant to our user community.
There have been quite a number of blog posts about Debezium lately; here are some of the latest ones that you should not miss:
This recent blog by Gunnar Morling discusses how Debezium combined with Kafka stream post processing can deliver an enriched stream of events suitable for even the most complicated of tasks like audit tracking.
Rod Shokrian from Varo recently blogged about their CDC solution and experiences using Debezium in conjunction with the Outbox Pattern.
Community involvement is critical to each Open Source project and Debezium is no different. Joy Gao blogs about her experience at WePay where CDC innovation brought Cassandra and Debezium together.
This slide deck by Anna McDonald showcases Debezium capturing database change events in complex architectures to emit enriched, derivative-based events across your enterprise.
There are quite a number of applicable use cases for Debezium. Dave Cramer from Crunchy Data recently blogged about his experiences using Debezium to replicate data between both a source and sink PostgreSQL environment using CDC and Apache Kafka.
Data analytics are vital across lots of industries. This post by Adrian Kreuziger discusses how Convoy used Debezium and Apache Kafka to design a low-latency data warehouse solution for the trucking industry.
You can also checkout our online resources for more…
An example is often much like a picture, its worth a thousand words. Debezium’s examples repository has recently undergone changes introducing new examples and update existing ones:
Time to upgrade
Debezium version 0.10.0.Final was released at the beginning of October. If you are using the 0.9 branch, we urge you to check out the latest major release. For details on the bug fixes, enhancements, and improvements that spanned 8 preview releases, check out the release-notes.
The Debezium team has also begun active development on the next major version, 1.0. If you want details on the bug fixes, enhancements, and improvements, you can view release-notes for more details.
Questions and answers
It can often be overwhelming when starting work on an existing code base. We welcome community contributions and we want to make the process of getting started extremely easy. Below is a list of open issues that are currently labeled with
easy-starter if you want to dive in quick.
Configure Avro serialization automatically when detecting link to schema registry (DBZ-59)
Add tests for using fallback values with default REPLICA IDENTITY (DBZ-1158)
Add ability to insert fields from op field in ExtractNewRecordState SMT (DBZ-1452)
Support CREATE TABLE … LIKE syntax for blacklisted source table (DBZ-1496)
Provide change event JSON Serde for Kafka Streams (DBZ-1533)
Explore SMT for Externalizing large column values (DBZ-1541)
Whitespaces not stripped from table.whitelist (DBZ-1546)
We intend to publish new additions of this newsletter periodically. Should anyone have any suggestions on changes or what could be highlighted here, we welcome that feedback. You can reach out to us via any of our community channels found here.
Debezium is an open source distributed platform that turns your existing databases into event streams, so applications can see and respond almost instantly to each committed row-level change in the databases. Debezium is built on top of Kafka and provides Kafka Connect compatible connectors that monitor specific database management systems. Debezium records the history of data changes in Kafka logs, so your application can be stopped and restarted at any time and can easily consume all of the events it missed while it was not running, ensuring that all events are processed correctly and completely. Debezium is open source under the Apache License, Version 2.0.
We hope you find Debezium interesting and useful, and want to give it a try. Follow us on Twitter @debezium, chat with us on Zulip, or join our mailing list to talk with the community. All of the code is open source on GitHub, so build the code locally and help us improve ours existing connectors and add even more connectors. If you find problems or have ideas how we can improve Debezium, please let us know or log an issue.