You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm trying to write messages from Kafka to ClickHouse. The messages are being received via Debezium, and I am using the image altinity/clickhouse-sink-connector:2.4.0-kafka.
Problem: The connector shows zero lag, and offsets exist, but no logs are available in the container, and data is not being written to ClickHouse.
Kafka Offsets
The offsets exist, but no processing is happening.
I'm trying to write messages from Kafka to ClickHouse. The messages are being received via Debezium, and I am using the image altinity/clickhouse-sink-connector:2.4.0-kafka.
Problem: The connector shows zero lag, and offsets exist, but no logs are available in the container, and data is not being written to ClickHouse.
Kafka Offsets
The offsets exist, but no processing is happening.
Configuration File
Here is my configuration for the connector:
{
"name": "clickhouse-sink-connector-10",
"config": {
"connector.class": "com.altinity.clickhouse.sink.connector.ClickHouseSinkConnector",
"tasks.max": "1",
"topics": "pg-source-1.public.t1",
"topics.regex" : "pg-source-1.*",
"clickhouse.server.url": "http://clickhouse",
"clickhouse.server.user": "default",
"clickhouse.server.password": "",
"clickhouse.topic2table.map": "pg-source-1.public.t1:default.t1",
"metrics.enable": "false",
"auto.create.tables": "true",
"auto.create.tables.replicated": "false",
"schema.evolution": "true",
"snowflake.id": "false",
"replacingmergetree.delete.column": "id",
"enable.kafka.offset": "true",
"errors.log.enable": "true",
"errors.log.include.messages": "true",
"key.converter": "org.apache.kafka.connect.json.JsonConverter",
"key.converter.schemas.enable": "true",
"value.converter": "org.apache.kafka.connect.json.JsonConverter",
"value.converter.schemas.enable": "true"
}
}
Observations
The messages from Debezium are being received successfully:
Troubleshooting Steps Already Tried
Let me know if additional details are needed, or if you have any suggestions!
The text was updated successfully, but these errors were encountered: