Skip to content

[LI-HOTFIX] Reduce exception log spam in producer IO thread

Latest
Compare
Choose a tag to compare
@Q1Liu Q1Liu released this 24 Jan 22:38
e15c196

Fixes LIKAFKA-62226

Certain issues, such as DNS resolution failures, can cause the producer IO thread to spew log messages rapidly. This can cause disks to fill and hide other issues. This commit addresses this issue by adding a producer configuration that throttles exception log messages from the top of the producer IO thread. The throttling is a simple cooldown-based rate limiter, and is applied per-exception. Exceptions are differentiated based on their printStackTrace result, which covers exception type, construction point, causes, etc.