Featured Posts

Tags
analytics announcement announcement discussion survey apache kafka apache kafka apicurio avro aws batch caassandra camel cassandra cdc channels community community stories connectors containers cqrs custom datalake db2 ddd debezium debezium server debezium ui deduplication discussion docker elasticsearch event sourcing exactly once semantics example examples features fedora flink hiring ibmi iceberg images informix integration introduction jaeger jdbc json kafka kafka streams kafka streams kogito ksql kubernetes lakehouse machine learning mariadb metrics microservices mongo mongodb monitoring mysql news newsletter notifications online learning operator oracle outbox performance postgres presentation production quarkus questdb rds releases schema scylla secrets sentry serialization signaling smt snapshots spanner spark sql sqlserver tensorflow testcontainers tests time series timescaledb topics tracing transactions ui vagrant vitess website

Welcome to the Debezium community newsletter in which we share all things CDC related including blog posts, group discussions, as well as StackOverflow questions that are relevant to our user community.

Upcoming Events

Articles

There have been quite a number of blog posts about Debezium lately; here are some of the latest ones that you should not miss:

This recent blog by Gunnar Morling discusses how Debezium combined with Kafka stream post processing can deliver an enriched stream of events suitable for even the most complicated of tasks like audit tracking.

Rod Shokrian from Varo recently blogged about their CDC solution and experiences using Debezium in conjunction with the Outbox Pattern.

Community involvement is critical to each Open Source project and Debezium is no different. Joy Gao blogs about her experience at WePay where CDC innovation brought Cassandra and Debezium together.

This slide deck by Anna McDonald showcases Debezium capturing database change events in complex architectures to emit enriched, derivative-based events across your enterprise.

There are quite a number of applicable use cases for Debezium. Dave Cramer from Crunchy Data recently blogged about his experiences using Debezium to replicate data between both a source and sink PostgreSQL environment using CDC and Apache Kafka.

Data analytics are vital across lots of industries. This post by Adrian Kreuziger discusses how Convoy used Debezium and Apache Kafka to design a low-latency data warehouse solution for the trucking industry.

You can also checkout our online resources for more…​

Examples

An example is often much like a picture, its worth a thousand words. Debezium’s examples repository has recently undergone changes introducing new examples and update existing ones:

Time to upgrade

Debezium version 0.10.0.Final was released at the beginning of October. If you are using the 0.9 branch, we urge you to check out the latest major release. For details on the bug fixes, enhancements, and improvements that spanned 8 preview releases, check out the release-notes.

The Debezium team has also begun active development on the next major version, 1.0. If you want details on the bug fixes, enhancements, and improvements, you can view release-notes for more details.

Questions and answers

Using Debezium?

We recently added a community users page to https://debezium.io. If you are a user of Debezium and would like to be included, please send us a GitHub pull request or reach out to us directly.

Getting involved

It can often be overwhelming when starting work on an existing code base. We welcome community contributions and we want to make the process of getting started extremely easy. Below is a list of open issues that are currently labeled with easy-starter if you want to dive in quick.

  • Configure Avro serialization automatically when detecting link to schema registry (DBZ-59)

  • Add tests for using fallback values with default REPLICA IDENTITY (DBZ-1158)

  • Add ability to insert fields from op field in ExtractNewRecordState SMT (DBZ-1452)

  • Support CREATE TABLE …​ LIKE syntax for blacklisted source table (DBZ-1496)

  • Provide change event JSON Serde for Kafka Streams (DBZ-1533)

  • Explore SMT for Externalizing large column values (DBZ-1541)

  • Whitespaces not stripped from table.whitelist (DBZ-1546)

Opportunities

We recently tweeted about an Internship opening on the Debezium project.

  • Are you in the Czech Republic area?

  • Are you passionate about Open Source?

  • Do you think change data capture is interesting?

If you answered yes to any or all of these, then you should definitely check out the details and apply!

Feedback

We intend to publish new additions of this newsletter periodically. Should anyone have any suggestions on changes or what could be highlighted here, we welcome that feedback. You can reach out to us via any of our community channels found here.

Chris Cranford

Chris is a software engineer at Red Hat. He previously was a member of the Hibernate ORM team and now works on Debezium. He lives in North Carolina just a few hours from Red Hat towers.

   

About Debezium

Debezium is an open source distributed platform that turns your existing databases into event streams, so applications can see and respond almost instantly to each committed row-level change in the databases. Debezium is built on top of Kafka and provides Kafka Connect compatible connectors that monitor specific database management systems. Debezium records the history of data changes in Kafka logs, so your application can be stopped and restarted at any time and can easily consume all of the events it missed while it was not running, ensuring that all events are processed correctly and completely. Debezium is open source under the Apache License, Version 2.0.

Get involved

We hope you find Debezium interesting and useful, and want to give it a try. Follow us on Twitter @debezium, chat with us on Zulip, or join our mailing list to talk with the community. All of the code is open source on GitHub, so build the code locally and help us improve ours existing connectors and add even more connectors. If you find problems or have ideas how we can improve Debezium, please let us know or log an issue.