Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade kafka-python==2.1.4 #36049

Open
wants to merge 8 commits into
base: master
Choose a base branch
from
Open

Upgrade kafka-python==2.1.4 #36049

wants to merge 8 commits into from

Conversation

millerdev
Copy link
Contributor

@millerdev millerdev commented Mar 22, 2025

Version bump for Python 3.13 compatibility. Reviewed change log and recent issues (no concerns).

Some refactoring was needed to support v2. In general the refactored code should be more efficient.

Safety Assurance

Safety story

Major version update with some non-trivial refactoring required. Planning to test on staging.

Automated test coverage

Yes.

Rollback instructions

  • This PR can be reverted after deploy with no further considerations.

@millerdev millerdev added the product/invisible Change has no end-user visible impact label Mar 22, 2025
@dimagimon dimagimon added the dependencies Pull requests that update a dependency file label Mar 22, 2025
@millerdev millerdev force-pushed the dm/upgrade-kafka-python branch 3 times, most recently from 3c31aa3 to a6d1422 Compare March 24, 2025 20:14
@millerdev millerdev changed the title Upgrade kafka-python==2.1.1 Upgrade kafka-python==2.1.2 Mar 24, 2025
@millerdev millerdev marked this pull request as ready for review March 24, 2025 20:16
@millerdev millerdev force-pushed the dm/upgrade-kafka-python branch from 1d587c4 to bfedf86 Compare March 31, 2025 16:29
@millerdev millerdev changed the title Upgrade kafka-python==2.1.2 Upgrade kafka-python==2.1.4 Mar 31, 2025
- Allow more accurate type introspection in IDEs.
- Remove superfluous object base class.
Some things are broken. Specifically, SimpleClient has been removed in
Kafka 2.x, and more refactoring is required for code that uses it.
The new technique has better performance because it polls at most twice
rather than one or more times for each topic.
The kafka-python v2 async consumer seems to take more time to start.
Verify fix for regression in kafka-python>=2,<2.1.3
@millerdev millerdev force-pushed the dm/upgrade-kafka-python branch from bfedf86 to 28eeb96 Compare March 31, 2025 16:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file product/invisible Change has no end-user visible impact
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants