Skip to content

Conversation

@rodesai
Copy link
Contributor

@rodesai rodesai commented Jun 28, 2024

No description provided.

Copy link
Contributor

@agavra agavra left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

some suggestions for improved logging

private void maybeBackOffEnqueuingNewEventWithKey(final KIn key) {
while (schedulingQueue.keyQueueIsFull(key)) {
// TODO: switch to a periodic log
log.debug("key queue is full. back off until there is room on key queue");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: let's log which key is backing off, size of queue and back off time (if that's easily accessible)

log.info("Cancelling {} pending records for {}[{}]",
inFlightForTask.size(), processorName, partition);
if (!inFlightForTask.isEmpty()) {
log.info("ANTITHESIS SOMETIMES: cancelling {} pending records for {}[{}]",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is ANTITHESIS SOMETIMES a pragma?


int size();

int blockedEntries();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: numBlockedEntries()


public void flush(final long consumedOffset) {
if (consumedOffset < lastFlushedOffset) {
log.error("trying to commit an offset {} older than last flushed {}",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

when can this happen? Can we make this error message more actionable (or is it safe to ignore/just got fenced?)

+ "for this topic partition (%s)", threadId, topicPartition));
}
if (storesForThread.size() > 1) {
LOGGER.warn("found more than 1 registration: {}",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

probably already in each registration but let's just add found more than 1 registration for {threadId}: {}"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants