update to latest #1
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Updated zlib download url from https://zlib.net/ to https://zlib.net/fossils/ as the former doesn't work for all the versions anymore * Removed changelog changes
since OpenSSL 3 does not support RC2 out of the box (legacy provider needed).
…4022) * Config: remove upper limit on queue.buffering.max.messages (#4018) The current limit of 10 million messages is quite low when using compression Users may also want to bound the queue by it's memory usage exclusively * typos in rdkafka_conf.c Co-authored-by: Magnus Edenhill <[email protected]> * remove diffs from configuration.md * undo enum formatting Co-authored-by: Magnus Edenhill <[email protected]>
* Metadata handler upgrade to version 12 and offset leader epoch fix in ListOffsets * Fixed tag for alpine and manylinux images * Update msys2 installer and fix for missing CURL_LIBRARIES * Fix request by topic name when topic id is available
* Add files for lz4 1.9.4 * Update changelog.md * rdxxhash should not be in clang-format list * Add instructions and update memory alloc/free * Update instructions for lz4
Remove kafka-eng as it's too wide.
Fixes a segfault when a segment is erased and more data is written to the buffer.
`resolve_canonical_bootstrap_servers_only` must only be used with Kerberos
…tructed identically when retried (#4750) Issues: #4736 Fix for an idempotent producer error, with a message batch not reconstructed identically when retried. Caused the error message "Local: Inconsistent state: Unable to reconstruct MessageSet". Happening on large batches. Solved by using the same backoff baseline for all messages in the batch. Happens since 2.2.0
- Style fix - RPC version update - Fix uninitialized value and topic name from rkt - Revert newline changes - Remove duplicate declaration - Rename rd_kafka_buf_write_tags to rd_kafka_buf_write_tags_empty before implementing the define that allows to write tags - Upgrade fetch mock handler to v15 - devel assertion and logging improvements Co-authored-by: Emanuele Sabellico <[email protected]>
client mock cluster implementation --------- Co-authored-by: Emanuele Sabellico <[email protected]>
and for tags common to Fetch and Produce in KIP-951 --------- Co-authored-by: mahajanadhitya <[email protected]> Co-authored-by: Emanuele Sabellico <[email protected]>
* update third party dependencies * update lz4 version in the header file * update libraries for the windows build * reverting the version bump in the headers * use the latest version of curl * Update OpenSSL and add CHANGELOG.md * downgade curl version to one available via vcpkg * downgrade zlib to last available version in vcpkg * downgrade zstd to the latest available * Include CPPFLAGS within make for libcurl * Update mklove/modules/configure.libcurl * Update CHANGELOG.md --------- Co-authored-by: Milind L <[email protected]> Co-authored-by: Emanuele Sabellico <[email protected]>
contains the code changes to trigger a metadata update when the corresponding tags are received by the broker for partitions that have changed leadership, during Fetch or Produce requests.
Version 2.5.0-RC1
* Add test and mock files * Remove unnecessary semicolons * Review comments: * Fix to reduce flakyness of test 0146/do_test_stale_metadata_doesnt_migrate_partition * CHANGELOG and INTRODUCTION documentation --------- Co-authored-by: Anchit Jain <[email protected]>
Later versions of zstd fail without -lrt, see facebook/zstd#3558 .
*Remove CentOS 6 and 7 support as discontinued, keeps using manylinux_2_28 based on AlmaLinux 8 (CentOS 8) * Remove fix for CentOS 6 * Add CHANGELOG entry * Upgrade test and verify package creation or installation using clients repository
KIP 714 with compression support (#4721) implemented GetTelemetrySubscriptions and PushTelemetry to send client telemetry to the requesting broker. Available metrics: * producer.connection.creation.rate * producer.connection.creation.total * producer.node.request.latency.avg * producer.node.request.latency.max * producer.produce.throttle.time.avg * producer.produce.throttle.time.max * producer.record.queue.time.avg * producer.record.queue.time.max * consumer.connection.creation.rate * consumer.connection.creation.total * consumer.node.request.latency.avg * consumer.node.request.latency.max * consumer.coordinator.assigned.partitions Compression is supported with zstd, zlib, lz4, or snappy. --------- Co-authored-by: Milind L <[email protected]>
and add build checks with different configurations
…ide during send push telemetry call (#4826)
fallback happens when any topic to fetch has a zero topic id, that can happen if the cluster has a Fetch version that is greater or equal to 13 but an inter broker protocol version that is less than 2.8
add missing consumer metrics described in the KIP: * consumer.coordinator.rebalance.latency.avg * consumer.coordinator.rebalance.latency.max * consumer.coordinator.rebalance.latency.total * consumer.fetch.manager.fetch.latency.avg * consumer.fetch.manager.fetch.latency.max * consumer.poll.idle.ratio.avg * consumer.coordinator.commit.latency.avg * consumer.coordinator.commit.latency.max additionally: * add unit tests for all the metrics * add integrations tests with the producer or consumer while they're active * configurable group initial rebalance delay ms to make integration tests reusable with both producer and consumer --------- Co-authored-by: mahajanadhitya <[email protected]> Co-authored-by: Anchit Jain <[email protected]> Co-authored-by: Emanuele Sabellico <[email protected]>
also fix macOS build issue --------- Co-authored-by: Emanuele Sabellico <[email protected]>
Co-authored-by: mahajanadhitya <[email protected]>
…tions (#4845) * electLeaders Api 1st draft * Minor change * Elect Leaders API final * minor change * Added a function * Minor Change * removed binary file from pr * Style fix * Resolve documentation errors * resolved build errors * first round of comments * name fixes * second round of comments * memory deallocation fix * Changelog changes addition * changes * variable naming change * third round comments * grammar change * latest changes * additional formatting * documentation changes * additional comments * one more round comments * election type count * name change election type cnt * new comments * removing election type check * removing merge conflicts * changelog.md changes * new changes * Fixing failing tests * Moved top level error code from response to event * changed topic partition result structure * style fix * remove null partitions check * requested changes * introduction md formatting * requested changes * partitions cnt print --------- Co-authored-by: Pranav Rathi <[email protected]>
Co-authored-by: John "Preston" Mille <[email protected]>
from external API and avoid exposing internal destructor
AK 2.7 is the first version implementing Fetch 12, before that it shouldn't fallback to v12, neither check if topic IDs are supported.
when potential topic partitions are less than number of members.
) as replicas reply with "NOT_LEADER_OR_FOLLOWER" when using the replica id, Java clients sends requests to the leader too. Co-authored-by: Kyle Phelps <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.