Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KAFKA-17609:[4/4]Convert system tests to kraft part 4 #17328

Merged

Conversation

bbejeck
Copy link
Contributor

@bbejeck bbejeck commented Sep 30, 2024

  1. Streams smoke test
  2. Static membership test
  3. Streams upgrade test

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@github-actions github-actions bot added the tests Test fixes (including flaky tests) label Sep 30, 2024
@bbejeck
Copy link
Contributor Author

bbejeck commented Sep 30, 2024

Links to passing tests

Streams smoke test
Static membership test
Streams upgrade test

@mjsax mjsax added the streams label Oct 7, 2024
@bbejeck bbejeck force-pushed the KAFKA-17609_convert_system_tests_to_kraft_part_4 branch from 487f524 to 00821d6 Compare October 16, 2024 20:35
@@ -49,8 +49,8 @@ def __init__(self, test_context):
@cluster(num_nodes=8)
@matrix(processing_guarantee=['exactly_once_v2', 'at_least_once'],
crash=[True, False],
metadata_quorum=quorum.all_non_upgrade)
def test_streams(self, processing_guarantee, crash, metadata_quorum=quorum.zk):
metadata_quorum=[quorum.combined_kraft])
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we remove metadata_quorum as parameter entirly ?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Required to indicate to use KRaft for metadata quorum. Failing to do so without a @matrix annotation results in this error as the test will default to ZK without it.

    zk_sasl=self.zk.zk_sasl if self.quorum_info.using_zk else False, zk_tls=self.zk_client_secure,
AttributeError: 'NoneType' object has no attribute 'zk_sasl'

def test_rolling_upgrade_with_2_bounces(self, from_version):
@matrix(from_version=metadata_2_versions, metadata_quorum=[quorum.combined_kraft])
@matrix(from_version=fk_join_versions, metadata_quorum=[quorum.combined_kraft])
def test_rolling_upgrade_with_2_bounces(self, from_version, metadata_quorum):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why are we adding metadata_quorum parameter? Seems unncessary?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Required to indicate to use KRaft for metadata quorum. Failing to do so without a @matrix annotation results in this error as the test will default to ZK without it.

    zk_sasl=self.zk.zk_sasl if self.quorum_info.using_zk else False, zk_tls=self.zk_client_secure,
AttributeError: 'NoneType' object has no attribute 'zk_sasl'

@@ -245,7 +147,8 @@ def test_rolling_upgrade_with_2_bounces(self, from_version):
self.stop_and_await()

@cluster(num_nodes=6)
def test_version_probing_upgrade(self):
@matrix(metadata_quorum=[quorum.combined_kraft])
def test_version_probing_upgrade(self, metadata_quorum):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

as above

@matrix(from_version=[str(LATEST_3_2), str(DEV_VERSION)], upgrade=[True, False])
def test_upgrade_downgrade_state_updater(self, from_version, upgrade):
@matrix(from_version=[str(LATEST_3_2), str(DEV_VERSION)], upgrade=[True, False], metadata_quorum=[quorum.combined_kraft])
def test_upgrade_downgrade_state_updater(self, from_version, upgrade, metadata_quorum):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

as above

Copy link
Member

@mjsax mjsax left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You answered the open question on the other PRs. LGTM.

@bbejeck bbejeck force-pushed the KAFKA-17609_convert_system_tests_to_kraft_part_4 branch from fe95ff6 to 1c3a33c Compare October 22, 2024 15:22
@bbejeck
Copy link
Contributor Author

bbejeck commented Oct 30, 2024

Link for passing tests in this PR

zk_to_kraft_pr_conversion_results

@bbejeck bbejeck merged commit 3d2edf8 into apache:trunk Oct 30, 2024
2 of 4 checks passed
@bbejeck
Copy link
Contributor Author

bbejeck commented Oct 30, 2024

Merged #17328 into trunk

@bbejeck bbejeck deleted the KAFKA-17609_convert_system_tests_to_kraft_part_4 branch October 30, 2024 16:55
abhishekgiri23 pushed a commit to abhishekgiri23/kafka that referenced this pull request Nov 2, 2024
Part 4 of 4 converting streams system tests to KRaft

Reviewers: Matthias Sax <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
streams tests Test fixes (including flaky tests)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants