Featured Posts

Tags
apache kafka apache kafka apicurio avro aws batch caassandra camel cassandra cdc channels community community stories connectors containers cqrs custom datalake db2 ddd debezium debezium server debezium ui deduplication discussion docker elasticsearch event sourcing exactly once semantics example examples features fedora flink hiring ibmi iceberg informix integration introduction jaeger jdbc json kafka kafka streams kafka streams kogito ksql kubernetes lakehouse machine learning mariadb microservices mongo mongodb mysql news newsletter notifications online learning operator oracle outbox performance postgres presentation production quarkus questdb rds releases schema scylla secrets sentry serialization signaling smt snapshots spanner spark sql sqlserver tensorflow testcontainers tests time series timescaledb topics tracing transactions vagrant vitess website

The Debezium team is happy to announce the release of Debezium 0.9.2.Final!

This is mostly a bug-fix release and a drop-in replacement for earlier Debezium 0.9.x versions. Overall, 18 issues were resolved.

A couple of fixes relate to the Debezium Postgres connector:

  • When not using REPLICA IDENTITY FULL, certain data types could trigger exceptions for update or delete events; those are fixed now (DBZ-1141, DBZ-1149)

  • The connector won’t fail any longer when encountering a change to a row with an unaltered TOAST column value (DBZ-1146)

Also the Debezium MySQL connector saw a number of fixes:

  • The connector works correctly now when using GTIDs and ANSI_QUOTES SQL mode (DBZ-1147)

  • The new Antlr-based DDL parsers can handle column names that are key words such as MEDIUM (DBZ-1150)

  • TIME columns with a default value larger than 23:59:59 can be exported now (DBZ-1137)

Another important fix was done in the Debezium connector for SQL Server, where the connector archive deployed to Maven Central accidentally contained all test-scoped and provided-scoped dependencies. This has been resolved now, so the connector archive only contains the actually needed JARs and thus is much smaller (DBZ-1138).

New Features

The 0.9.2 release also comes with two small new features:

  • You can pass arbitrary parameters to the logical decoding plug-in used by the Postgres connector; this can for instance be used with wal2json to limit the number of tables to capture on the server side (DBZ-1130)

  • The MongoDB connector now has the long-awaited snapshotting mode NEVER (DBZ-867), i.e. you can set up a new connector without taking an initial snapshot and instantly beginning streaming changes from the oplog

Version Updates

As of this release, Debezium has been upgraded to Apache Kafka 2.1.1. Amongst others, this release fixes an issue where the Kafka Connect REST API would expose connector credentials also when those were configured via secrets (KAFKA-5117). We’ve also upgraded the binlog client used by the MySQL connector to version 0.19.0 (DBZ-1140), which fixes a bug that had caused exceptions during rebalancing the connector before (DBZ-1132).

Check out the release notes for the complete list of issues fixed in Debezium 0.9.2.

Many thanks to Debezium community members Andrey Pustovetov, Keith Barber, Krizhan Mariampillai and Taylor Rolison for their contributions to this release!

Gunnar Morling

Gunnar is a software engineer at Decodable and an open-source enthusiast by heart. He has been the project lead of Debezium over many years. Gunnar has created open-source projects like kcctl, JfrUnit, and MapStruct, and is the spec lead for Bean Validation 2.0 (JSR 380). He’s based in Hamburg, Germany.

   

About Debezium

Debezium is an open source distributed platform that turns your existing databases into event streams, so applications can see and respond almost instantly to each committed row-level change in the databases. Debezium is built on top of Kafka and provides Kafka Connect compatible connectors that monitor specific database management systems. Debezium records the history of data changes in Kafka logs, so your application can be stopped and restarted at any time and can easily consume all of the events it missed while it was not running, ensuring that all events are processed correctly and completely. Debezium is open source under the Apache License, Version 2.0.

Get involved

We hope you find Debezium interesting and useful, and want to give it a try. Follow us on Twitter @debezium, chat with us on Zulip, or join our mailing list to talk with the community. All of the code is open source on GitHub, so build the code locally and help us improve ours existing connectors and add even more connectors. If you find problems or have ideas how we can improve Debezium, please let us know or log an issue.