Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

adds a Kafka message consumer using the Sarama library #64

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Commits on Jul 17, 2024

  1. adds a Kafka message consumer using the Sarama library

    These are a handful of data structures and behaviors that can be combined to provide flexible
    processing of Kafka messages.
    
    SaramaMessageConsumer is tightly focused on the consumption of Kafka messages. **This is the
    interface that other packages will want to implement in order to process Kafka messages.** Being
    a simple interface, it can easily be extended to provide additional behavior, such as
    retries. One such example is implemented, the NTimesRetryingConsumer.
    
    SaramaConsumerGroupHandler implements sarama.ConsumerGroupHandler. The handler is controlled by
    the consumer group, and is responsible for managing the lifecycle of a SaramaMessageConsumer. It
    can be extended if the need for more lifecycle support is required.
    
    The SaramaEventsConsumer combines a SaramaMessageConsumer and a SaramaConsumerGroupHandler
    providing them with a simple lifecycle API (the Run() method). This allows other systems (namely
    platform) to use a very thin adapter layer to control the lifecycle of the consumer.
    
    BACK-2554
    ewollesen committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    e6945d3 View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2024

  1. WIP: adding topic shifting retry consumer

    Have the basics there, but need to:
    
    + write tests
    + test it
    + manage consumers for the other topics, whether here or somewhere else
    ewollesen committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    af75a36 View commit details
    Browse the repository at this point in the history
  2. WIP: fan out consumer

    ewollesen committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    9b012dd View commit details
    Browse the repository at this point in the history