Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GrafanaRequestsFailing: fix many-to-one matching must be explicit error #2592

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

vroldanbet
Copy link

Hey folks 👋🏻

I got paged because this alert started failing to evaluate with the many-to-one matching must be explicit (group_left/group_right) error.

The left-hand side keeps the "status_code" label in the time series, which can lead to one single handler having multiple time series. When divided by the right-hand expression, it won't contain the status_code, leading to a many-to-one error.

I solved this by removing the status_code from the left-hand side. If I'm not mistaken, that also means we can get rid of ignoring. It could have been addressed with group_left, but the proposed expression seemed easier to follow. The expression should retain the "trigger on a per-route basis" intent.

I think this has always been incorrect, but I'm I'm surprised no one has experienced it.

I also noticed the runbook does not exist, so I removed it to avoid confusion

the left hand side keeps the "status_code" label
in the time series, which can lead to one single
handler having multiple time series. When divided
right hand expression, it won't contain the status_code
leading to many-to-one error.

This is an issue because while the alert is a warning,
a failure to evaluate a rule is a sev1.

I think this has always been incorrect, but I'm
surprised no one has experienced it.

I also noticed the runbook does not really exist,
so I removed it to avoid confusion
@vroldanbet vroldanbet requested a review from a team as a code owner January 24, 2025 22:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants