Sink connector Kafka(added binary encoding option)

Added option to write UUID/BLOB(Debezium.BYTES) datatype as raw bytes instead of encoding as Base64 or HEX strings.

pre_release_1.0.0

Config.yml needs to be updated
From offset.storage.offset.storage.jdbc.offset.table.name to offset.storage.jdbc.offset.table.name
From offset.storage.offset.storage.jdbc.offset.table.ddl to offset.storage.jdbc.offset.table.ddl

• Fix for gtid overflow integer error.

clickhouse-debezium-embedded-1.1-SNAPSHOT.jar

Support for Postgres data types(Array)

What's Changed

• Added logic to ignore deletes by @subkanthi in #282
• Fix kakfa metadata in Kafka sink connector by @subkanthi in #286
• Docusarus docs by @subkanthi in #283
• Added support for postgresql data types(including Array). by @subkanthi in #297
• 296 postgresql data types add test cases and support by @subkanthi in #298

Full Changelog: release_0.7.0...release_0.9.0

release_0.7.0

What's Changed

• Added logic to set lsn through REST API. by @subkanthi in #275

Full Changelog: release_0.6.0...release_0.7.0

Sink connector client

What's Changed

• Changes to support yaml file configuration in Integration tests. by @subkanthi in #255
• Added logic to use yml file for Integration tests. by @subkanthi in #269

Full Changelog: release_0.5.0...release_0.6.0

Docker: registry.gitlab.com/altinity-public/container-images/clickhouse_debezium_embedded:2023-07-26

release_0.5.0

What's Changed

• Updated README.md and postgres configuration files. by @subkanthi in #256
• Updated standalone docker-compose files. by @subkanthi in #264
• 259 - Fix bug where the version column might be retrieved from the wr… by @subkanthi in #261
• Fixed bug with retrieving metadata without database name by @subkanthi in #265
• Postgres fixes to support Debezium 2.3(Changes to configuration varia… by @subkanthi in #266
• Sink connector cli by @subkanthi in #260

Full Changelog: release_0.4.0...release_0.5.0

release_0.4.0

What's Changed

• Disable snapshot ddl by @subkanthi in #227
• Logic added to use replacingmergetree with the is_deleted column. by @subkanthi in #234
• Debezium jdbc storage by @subkanthi in #240

Full Changelog: release_v5...release_0.4.0

Lightweight version(Replicator without Kafka connect)

What's Changed

• Added support for CREATE TABLE like. by @subkanthi in #217
• 216 add support for create table like by @subkanthi in #222
• 216 add support for create table like by @subkanthi in #225

Full Changelog: release_v4...release_v5

Lightweight version(Replicator without Kafka connect)

What's Changed

• Remove references to clickhousetablename not used by @subkanthi in #72
• Useful MySQL settings by @aadant in #83
• Adding scripts to test classic databases by @aadant in #82
• python scripts to run checksums by @aadant in #80
• 78 the virtual columns should be _version and _sign by @subkanthi in #88
• Changed camel case functions to snake case. by @subkanthi in #86
• 77 add sakila employees database by @subkanthi in #84
• Revert "77 add sakila employees database" by @subkanthi in #92
• Changes to sakila db. by @subkanthi in #93
• Added documentation for Confluent Schema Registry REST API. by @subkanthi in #91
• clickhouse_loader initial release by @aadant in #96
• Better support for dates, schema generation fixes for fractional dates and timestamps by @aadant in #97
• Sakila db fixes by @subkanthi in #98
• Integrate sakila employees database by @subkanthi in #103
• Support most data types by @aadant in #112
• Support all MySQL data types + bug fix + basic partitioning by @aadant in #117
• TestFlows Sink tests v.1 integration to develop by @AlmostIvanSidorov in #115
• Add meaningful digits to data_types.sql by @aadant in #121
• Refactor insert batch by @subkanthi in #110
• 122 remove trailing zeros in timestamp and time columns by @subkanthi in #126
• Updating README.md by @subkanthi in #127
• Map Float64(Debezium) to Float32(CH) by @subkanthi in #131
• GitHub action push docker image by @subkanthi in #136
• Fixed trim of trailing '.' in mysql checksum calculation. by @subkanthi in #138
• Added delay to configure connectors, added script to start docker con… by @subkanthi in #135
• Added lag metrics in Grafana dashboard. by @subkanthi in #142
• 140 unique identifier to support mysql failover by @subkanthi in #143
• Added JVM metrics, updated Grafana dashboard by @subkanthi in #145
• Fixes for clickhouse_loader when the sql files are empty. by @subkanthi in #153
• Grafana improvements by @subkanthi in #146
• Updated debezium to 2.1 Final by @subkanthi in #154
• Documented Sink connector configuration in README by @subkanthi in #156
• Integration test using testcontainer, added logic to auto create kafka offset table. by @subkanthi in #159
• Fix version column parsing in ReplicatedReplacingMergeTree by @subkanthi in #165
• Added option in clickhouse checksum utility to connect to secure server by @subkanthi in #168
• Created Helm chart for sink connector. by @subkanthi in #147
• Added test case for float values. by @subkanthi in #171
• Removed out commented out statements in docker-compose.yaml by @subkanthi in #181
• Changes to support library by @subkanthi in #188
• 189 add mapping for postgresql UUID type by @subkanthi in #192
• testflows & github action tests by @AlmostIvanSidorov in #124
• 194 Fixed auto creation of table when after struct is empty by @subkanthi in #195
• Updated instructions for mysql shell, dumping tables. by @subkanthi in #198
• Add Mongo override docker and seed data. by @subkanthi in #173
• 194 error auto creating table when after struct is not available by @subkanthi in #199
• Lightweight version merge by @subkanthi in #200
• Modified pom.xml in lightweight to use sink-connector as additional s… by @subkanthi in #201
• widget to include parts insertion by @subkanthi in #204
• Updated README.md and postgresql/mongo instructions. by @subkanthi in #211
• Updated README.md and postgresql/mongo instructions. by @subkanthi in #212

New Contributors

• @AlmostIvanSidorov made their first contribution in #115

Full Changelog: release_0.2.0...release_v4

Release 0.3.0

What's Changed

• Remove references to clickhousetablename not used by @subkanthi in #72
• Useful MySQL settings by @aadant in #83
• Adding scripts to test classic databases by @aadant in #82
• python scripts to run checksums by @aadant in #80
• 78 the virtual columns should be _version and _sign by @subkanthi in #88
• Changed camel case functions to snake case. by @subkanthi in #86
• 77 add sakila employees database by @subkanthi in #84
• Revert "77 add sakila employees database" by @subkanthi in #92
• Changes to sakila db. by @subkanthi in #93
• Added documentation for Confluent Schema Registry REST API. by @subkanthi in #91
• clickhouse_loader initial release by @aadant in #96
• Better support for dates, schema generation fixes for fractional dates and timestamps by @aadant in #97
• Sakila db fixes by @subkanthi in #98
• Integrate sakila employees database by @subkanthi in #103
• Support most data types by @aadant in #112
• Support all MySQL data types + bug fix + basic partitioning by @aadant in #117
• TestFlows Sink tests v.1 integration to develop by @AlmostIvanSidorov in #115
• Add meaningful digits to data_types.sql by @aadant in #121
• Refactor insert batch by @subkanthi in #110
• 122 remove trailing zeros in timestamp and time columns by @subkanthi in #126
• Updating README.md by @subkanthi in #127
• Map Float64(Debezium) to Float32(CH) by @subkanthi in #131
• Release 0_3_0 by @subkanthi in #128

New Contributors

• @AlmostIvanSidorov made their first contribution in #115

Full Changelog: release_0.2.0...release_0.3.0