Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FIXED] (2.11) Respect consumer's starting seq, even if in the future #6253

Merged
merged 1 commit into from
Jan 23, 2025

Conversation

MauriceVanVeen
Copy link
Member

When using a replicated stream a consumer with a starting sequence could be created on a follower that's ever so slightly behind on applies. If the starting sequence is higher than the stream's last sequence we would clamp it down.
We should not be clamping it down, and must respect what the user/client gave us. That ensures any messages the user/client gets are always message.seq>=starting_seq as well.

However, if the consumer is used for mirroring/sourcing then we should still clamp down.

Signed-off-by: Maurice van Veen [email protected]

@MauriceVanVeen MauriceVanVeen requested a review from a team as a code owner December 13, 2024 14:23
@MauriceVanVeen MauriceVanVeen force-pushed the maurice/consumer-respect-start-seq branch from 6902961 to a1d3f00 Compare December 13, 2024 14:31
@MauriceVanVeen MauriceVanVeen force-pushed the maurice/consumer-respect-start-seq branch 2 times, most recently from 31b599f to 900fd35 Compare December 23, 2024 17:22
@neilalexander
Copy link
Member

What's the status of this one?

@MauriceVanVeen MauriceVanVeen force-pushed the maurice/consumer-respect-start-seq branch from 900fd35 to ddcc364 Compare January 23, 2025 09:13
@MauriceVanVeen
Copy link
Member Author

What's the status of this one?

It's ready for review.
Rebased Just now to fix a conflict.

@MauriceVanVeen
Copy link
Member Author

Looking at your comment here @neilalexander #6005 (comment):

and will rethink how to satisfy both use cases in 2.11

Maybe we should leave this for 2.11?

@neilalexander
Copy link
Member

Yes should be for 2.11.

@MauriceVanVeen MauriceVanVeen changed the title [FIXED] Respect consumer's starting seq, even if in the future [FIXED] (2.11) Respect consumer's starting seq, even if in the future Jan 23, 2025
Copy link
Member

@neilalexander neilalexander left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@derekcollison derekcollison merged commit 9c7cf29 into main Jan 23, 2025
5 checks passed
@derekcollison derekcollison deleted the maurice/consumer-respect-start-seq branch January 23, 2025 15:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants