You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
My service is hosted on Kubernetes cluster and my use case is, I have one consumer group as C1, which is consuming messages from topic T1 which has 70 partitions. I have fetched the latest committed offsets for topic T1 by the consumer C1 for all the 70 partitions. Now I have created a new, dynamic, consumer group for example as C2. So, as per my approach, I have committed offsets for all the 70 partitions and now I will fetch the assigned partitions for the particular pod of the new consumer group i.e. C2 and the seek and set the offsets of the assigned partitions as per old consumer C1.
So I am using group.Next() for getting the generation and from that I am fetching the assigned partitions for the particular pod of the C2. But here I am getting only half of partitions i.e. 35 partitions.
Any solve on this?
The text was updated successfully, but these errors were encountered:
shubhamsnehi
changed the title
Issue: Getting half partitions in Consumer Group Migration
Issue: Getting half partitions while Consumer Group Migration
Apr 24, 2024
My service is hosted on Kubernetes cluster and my use case is, I have one consumer group as C1, which is consuming messages from topic T1 which has 70 partitions. I have fetched the latest committed offsets for topic T1 by the consumer C1 for all the 70 partitions. Now I have created a new, dynamic, consumer group for example as C2. So, as per my approach, I have committed offsets for all the 70 partitions and now I will fetch the assigned partitions for the particular pod of the new consumer group i.e. C2 and the seek and set the offsets of the assigned partitions as per old consumer C1.
So I am using
group.Next()
for getting the generation and from that I am fetching the assigned partitions for the particular pod of the C2. But here I am getting only half of partitions i.e. 35 partitions.Any solve on this?
The text was updated successfully, but these errors were encountered: