SRE-87: Add CloudWatch alarms for RDS I/O monitoring #8005
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This was referenced Nov 3, 2025
Member
Author
github-actions
bot
added
area/infra
Contributor
Graphite Automations"Request DevOps reviewers once CI passes" took an action on this PR • (11/03/25)1 reviewer was added to this PR based on Tim Diekmann's automation. |
This was referenced Nov 4, 2025
vilkinsons
approved these changes
Nov 4, 2025
graphite-app
bot
changed the base branch from
t/sre-86-vanta-remediate-sql-database-freeable-memory-monitored-aws
to
graphite-base/8005
Adds DiskQueueDepth, ReadIOPS, and WriteIOPS alarms to satisfy Vanta requirement for database I/O monitoring (SRE-79). - DiskQueueDepth > 10 operations (CRITICAL) - ReadIOPS > 500 IOPS (WARNING) - WriteIOPS > 500 IOPS (WARNING) All alarms use 3/5 datapoints evaluation for anti-flapping and send notifications to PagerDuty via existing SNS topic.
Adds DatabaseConnections alarm to monitor connection pool exhaustion. - DatabaseConnections > 180 (~80% of max 225) (CRITICAL) - 2/3 datapoints evaluation over 15 minutes Connection exhaustion can block all database access, making this a critical metric to monitor.
TimDiekmann
force-pushed
the
t/sre-87-vanta-remediate-database-io-monitored-aws
branch
from
489cd81 to
f79246a
Compare
TimDiekmann
force-pushed
the
graphite-base/8005
branch
from
9f172c6 to
9aa271a
Compare
Contributor
Merge activity
|
TimDiekmann
deleted the
t/sre-87-vanta-remediate-database-io-monitored-aws
branch
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
🌟 What is the purpose of this PR?
Add RDS I/O performance monitoring CloudWatch alarms to detect potential database performance issues before they impact users.
🔍 What does this change?
Pre-Merge Checklist 🚀
🚢 Has this modified a publishable library?
This PR:
📜 Does this require a change to the docs?
The changes in this PR:
🕸️ Does this require a change to the Turbo Graph?
The changes in this PR:
🛡 What tests cover this?
❓ How to test this?