Featured Posts

Tags
apache kafka apache kafka apicurio avro aws batch caassandra camel cassandra cdc channels community community stories connectors containers cqrs custom datalake db2 ddd debezium debezium server debezium ui deduplication discussion docker elasticsearch event sourcing exactly once semantics example examples features fedora flink hiring ibmi iceberg informix integration introduction jaeger jdbc json kafka kafka streams kafka streams kogito ksql kubernetes lakehouse machine learning mariadb microservices mongo mongodb mysql news newsletter notifications online learning operator oracle outbox performance postgres presentation production quarkus questdb rds releases schema scylla secrets sentry serialization signaling smt snapshots spanner spark sql sqlserver tensorflow testcontainers tests time series timescaledb topics tracing transactions vagrant vitess website

I am pleased to announce the release of Debezium 1.4.0.Final!

This release concludes the major work put into Debezium over the last three months. Overall, the community fixed 117 issues during that time, including the following key features and changes:

  • New Vitess connector, featured in an in-depth blog post by Kewei Shang

  • Fine-grained selection of snapshotted tables

  • PostgreSQL Snapshotter completion hook

  • Distributed Tracing

  • MySQL support for create or read records emitted during snapshot

  • Many Oracle Logminer adapter improvements

  • Full support for Oracle JDBC connection strings

  • Improved reporting of DDL errors

Please refer to previous release announcements (Alpha1, Alpha2, Beta1, CR1) for more details. Since the CR1 release just before the holidays, we’ve focused on addressing some remaining bugs and improvements.

Thank you to everyone involved in testing the previous releases, this is invaluable by spotting and addressing any problems with new features as well as regressions. And of course we’d like to thank all the community members contributing to this release: Alisa Houskova, Anisha Mohanty, Andrey Ignatenko, Bingqin Zhou, Babur Duisenov, Arik Cohen, Faizan, Grant Cooksey, Matt Beary, Mohamed Pudukulathan, Sergei Morozov, Kewei Shang, Mans Singh, Martin Perez, Michael Wang, Alexander Iskuskov James Gormley, jinguangyang, Kaushik Iyer, Jeremy Ford, John Martin, Vadzim Ramanenka, Ramesh Reddy, Ganesh Ramasubramanian, Denis Andrejew, Travis Elnicky, Hoa Le, Yiming Liu, Yoann Rodière, and Peter Urbanetz.

Overall, more than 245 individuals have contributed to the Debezium project and the number of Debezium users continues to grow. As we usher in 2021, check out our recap of Debezium in 2020.

Outlook

With 1.4 Final released, planning for the 1.5 version (due by the end of March) is currently underway. The roadmap is still being discussed, so be sure to let us know about your requirements and feature requests. Some of the things we’re considering for this next release are:

  • Moving the MySQL connector to the CDC connector framework shared by most other Debezium connectors; this will drastically reduce maintenance burden of this connector in the future

  • Exploring more powerful snapshotting options (e.g. for parallelization and re-doing snapshots of selected tables)

  • Continued stability and improvements to the new LogMiner-based implementation for Oracle

Until then remain safe, it’s onwards and upwards from here!

Chris Cranford

Chris is a software engineer at Red Hat. He previously was a member of the Hibernate ORM team and now works on Debezium. He lives in North Carolina just a few hours from Red Hat towers.

   

About Debezium

Debezium is an open source distributed platform that turns your existing databases into event streams, so applications can see and respond almost instantly to each committed row-level change in the databases. Debezium is built on top of Kafka and provides Kafka Connect compatible connectors that monitor specific database management systems. Debezium records the history of data changes in Kafka logs, so your application can be stopped and restarted at any time and can easily consume all of the events it missed while it was not running, ensuring that all events are processed correctly and completely. Debezium is open source under the Apache License, Version 2.0.

Get involved

We hope you find Debezium interesting and useful, and want to give it a try. Follow us on Twitter @debezium, chat with us on Zulip, or join our mailing list to talk with the community. All of the code is open source on GitHub, so build the code locally and help us improve ours existing connectors and add even more connectors. If you find problems or have ideas how we can improve Debezium, please let us know or log an issue.