1.9.0

Highlights of this new minor release:

• Can now include Kafka headers in the document metadata.
• Updated dependencies.

1.8.1

This patch release addresses one issue:

• The CVE in the okio dependency has been addressed by upgrading to version 6.3.0 of the MarkLogic Java Client library, which depends on okio.

No other changes are present in this release.

1.8.0

Highlights of this new minor release:

• The connector is now also a source connector, accepting MarkLogic Optic queries for retrieving data as rows and sending them to Kafka topics.
• The sink connector now supports Kafka's dead letter queue.

The connector archive can be obtained from Confluent Hub . The self-contained jar required for use with Kafka can be downloaded from below.

1.7.0

Highlights of items addressed by this release:

• #70 Updated README provides documentation on all configuration options
• #4 Bulk Data Services can now be used for complete control over how data is ingested in case the configuration options do not suffice
• #50 Documents can now be inserted into temporal collections
• Connector is compiled against Kafka 2.8.1 and has been tested successfully on Kafka 3.2.0

To use the connector with Confluent Platform, please see the connector's page at Confluent Hub.

1.6.1

Updated the CloudFormation templates to use the latest MarkLogic AMI (10.0-8.2).

1.6.0

Fix optional parameters and running under Java 11

• Ensuring optional parameters are actually optional and do not cause a crash when they are not included.
• Fixing some Boolean and Integer casts now that the initial configuration object is a Hashmap of <String, Object> instead of <String, String>. Also fixed some tests that used that configuration object.
• Updating the build to use the ML client api v5.3.0 and the ML data hub v5.2.4. This should solve problems with running the connector with Java 11.

1.5.0

• Added options for logging incoming record keys and headers after write failures
• Updated the AWS CloudFormation Quick Start document
• Added documentation for using the connector with the AWS MSK (Kafka as a Service)

1.4.0

• Support for JSON Schema, ProtoBuf messages.
• Also support of ID strategies - UUID, JSONPATH,HASH, KAFKA_META_WITH_SLASH, KAFKA_META_HASHED
• Removing some erroneous comments in the example connect-standalone properties file.
• Changes for additional Security options
• Updated build.gradle to new kafka connect and datahub
• Updated Test Cases.
• Some forgotten cleanup left over from building the Confluent archive.

1.3.0

Support of additional authentication options.
Documentation of how to update the connector for security options. Refer to MarkLogic_Kafka_Connector_v1.3.0.pdf for details.

1.2.1

Fixed erroneous comments in the connect-standalone properties file.