From b90a2a38509b0662a1d81e6bc8a4ac5809b36e4e Mon Sep 17 00:00:00 2001 From: Maksim Davydov Date: Thu, 4 Jul 2024 18:21:03 +0300 Subject: [PATCH 1/2] IGNITE-18372 CDC metrics documentation update --- .../change-data-capture-extensions.adoc | 39 ++++++++++++++----- 1 file changed, 29 insertions(+), 10 deletions(-) diff --git a/docs/_docs/extensions-and-integrations/change-data-capture-extensions.adoc b/docs/_docs/extensions-and-integrations/change-data-capture-extensions.adoc index 399643e96adb2..1fd0897bfd51c 100644 --- a/docs/_docs/extensions-and-integrations/change-data-capture-extensions.adoc +++ b/docs/_docs/extensions-and-integrations/change-data-capture-extensions.adoc @@ -51,12 +51,13 @@ image:../../assets/images/integrations/CDC-ignite2igniteClient.svg[] === Metrics +[cols="25%,75%",opts="header"] |=== |Name |Description | `EventsCount` | Count of messages applied to destination cluster. -| `LastEventTime` | Timestamp of last applied event. -| `TypesCount` | Count of received binary types events. -| `MappingsCount` | Count of received mappings events. +| `LastEventTime` | Timestamp of last applied event to destination cluster. +| `TypesCount` | Count of binary types events applied to destination cluster. +| `MappingsCount` | Count of mappings events applied to destination cluster |=== == Ignite to Ignite CDC streamer @@ -80,12 +81,13 @@ image:../../assets/images/integrations/CDC-ignite2ignite.svg[] === Metrics +[cols="25%,75%",opts="header"] |=== |Name |Description | `EventsCount` | Count of messages applied to destination cluster. -| `LastEventTime` | Timestamp of last applied event. -| `TypesCount` | Count of received binary types events. -| `MappingsCount` | Count of received mappings events. +| `LastEventTime` | Timestamp of last applied event to destination cluster. +| `TypesCount` | Count of binary types events applied to destination cluster. +| `MappingsCount` | Count of mappings events applied to destination cluster |=== == CDC replication using Kafka @@ -118,11 +120,15 @@ image:../../assets/images/integrations/CDC-ignite2kafka.svg[] === IgniteToKafkaCdcStreamer Metrics +[cols="30%,70%",opts="header"] |=== |Name |Description -| `EventsCount` | Count of messages applied to destination cluster. -| `LastEventTime` | Timestamp of last applied event. -| `BytesSent` | Number of bytes send to Kafka. +| `EventsCount` | Count of messages applied to Kafka. +| `LastEventTime` | Timestamp of last applied event to Kafka. +| `TypesCount` | Count of binary types events applied to Kafka. +| `MappingsCount` | Count of mappings events applied to Kafka. +| `BytesSent` | Count of bytes sent to Kafka. +| `MarkersCount` | Count of metadata markers sent to Kafka. |=== === `kafka-to-ignite.sh` application @@ -164,7 +170,7 @@ Kafka to Ignite configuration file should contain the following beans that will . `java.util.Properties` bean with the name `kafkaProperties`: Single Kafka consumer configuration. . `org.apache.ignite.cdc.kafka.KafkaToIgniteCdcStreamerConfiguration` bean: Options specific to `kafka-to-ignite.sh` application. -[cols="20%,45%,35%",opts="header"] +[cols="25%,45%,30%",opts="header"] |=== |Name |Description | Default value | `caches` | Set of cache names to replicate. | null @@ -176,6 +182,19 @@ Kafka to Ignite configuration file should contain the following beans that will | `kafkaRequestTimeout` | Kafka request timeout in milliseconds. | `3000` | `maxBatchSize` | Maximum number of events to be sent to destination cluster in a single batch. | 1024 | `threadCount` | Count of threads to proceed consumers. Each thread poll records from dedicated partitions in round-robin manner. | 16 +|`metricRegistryName`| Name for metric registry. `org.apache.metricRegistryName.cdc.applier` | metrics +|=== + +=== Metrics + +[cols="35%,65%",opts="header"] +|=== +|Name |Description +| `EventsReceivedCount` | Count of events received from Kafka. +| `LastEventReceivedTime` | Timestamp of last received event from Kafka. +| `EventsSentCount` | Count of events sent to destination cluster. +| `LastBatchSentTime` | Timestamp of last sent batch to the destination cluster. +| `MarkersCount` | Count of metadata markers received from Kafka. |=== ==== Logging From 0f30c194224f95d66f9554a8eec23572e3040611 Mon Sep 17 00:00:00 2001 From: Maksim Davydov Date: Tue, 16 Jul 2024 09:39:22 +0300 Subject: [PATCH 2/2] IGNITE-18372 default value fixed --- .../change-data-capture-extensions.adoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/_docs/extensions-and-integrations/change-data-capture-extensions.adoc b/docs/_docs/extensions-and-integrations/change-data-capture-extensions.adoc index 1fd0897bfd51c..206f5fbb84231 100644 --- a/docs/_docs/extensions-and-integrations/change-data-capture-extensions.adoc +++ b/docs/_docs/extensions-and-integrations/change-data-capture-extensions.adoc @@ -182,7 +182,7 @@ Kafka to Ignite configuration file should contain the following beans that will | `kafkaRequestTimeout` | Kafka request timeout in milliseconds. | `3000` | `maxBatchSize` | Maximum number of events to be sent to destination cluster in a single batch. | 1024 | `threadCount` | Count of threads to proceed consumers. Each thread poll records from dedicated partitions in round-robin manner. | 16 -|`metricRegistryName`| Name for metric registry. `org.apache.metricRegistryName.cdc.applier` | metrics +|`metricRegistryName`| Name for metric registry. `org.apache.metricRegistryName.cdc.applier` | cdc-kafka-to-ignite |=== === Metrics