Skip to content

Conversation

@maycmlee
Copy link
Contributor

@maycmlee maycmlee commented Jan 26, 2026

What does this PR do? What is the motivation?

Update buffer metrics.
Preview: https://docs-staging.datadoghq.com/may/2.13-buffer-metrics/observability_pipelines/monitoring_and_troubleshooting/pipeline_usage_metrics/#buffer-metrics-when-buffering-is-enabled

Merge instructions

Merge readiness:

  • Ready for merge

For Datadog employees:

Your branch name MUST follow the <name>/<description> convention and include the forward slash (/). Without this format, your pull request will not pass CI, the GitLab pipeline will not run, and you won't get a branch preview. Getting a branch preview makes it easier for us to check any issues with your PR, such as broken links.

If your branch doesn't follow this format, rename it or create a new branch and PR.

[6/5/2025] Merge queue has been disabled on the documentation repo. If you have write access to the repo, the PR has been reviewed by a Documentation team member, and all of the required checks have passed, you can use the Squash and Merge button to merge the PR. If you don't have write access, or you need help, reach out in the #documentation channel in Slack.

Additional notes

@maycmlee maycmlee requested a review from a team as a code owner January 26, 2026 19:48
@github-actions github-actions bot added the Architecture Everything related to the Doc backend label Jan 26, 2026
Copy link
Contributor

@Jansen-w Jansen-w left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think I missed the pipelines.source_buffer_utilization_mean and pipelines.transform_buffer_utilization_mean metrics in the slack thread, sorry about that.

These both represent the exponentially weighted moving average (EWMA) of their respective metric

maycmlee and others added 4 commits January 26, 2026 15:59
Co-authored-by: Jansen <jansenwenb@gmail.com>
Co-authored-by: Jansen <jansenwenb@gmail.com>
Co-authored-by: Jansen <jansenwenb@gmail.com>
Copy link
Contributor

@bruceg bruceg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM


`pipelines.source_buffer_utilization`
: The percentage of a source's buffer that is used.
: Histogram of event count in a source's buffer. Sources ingest events, then write them to this buffer.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍🏻

@maycmlee maycmlee merged commit 9e922f3 into may/2.13-configurable-buffers Jan 27, 2026
19 checks passed
@maycmlee maycmlee deleted the may/2.13-buffer-metrics branch January 27, 2026 14:31
maycmlee added a commit that referenced this pull request Jan 27, 2026
* update doc

* small edit

* updates

* update destinations

* Apply suggestions from code review

Co-authored-by: Jansen <jansenwenb@gmail.com>

* edits

* Apply suggestions from code review

Co-authored-by: Jansen <jansenwenb@gmail.com>

* Apply suggestions from code review

* updates

* Apply suggestions from code review

Co-authored-by: Jansen <jansenwenb@gmail.com>

* Apply suggestions from code review

* fix link

* remove preview box and update links

* Apply suggestions from code review

Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>

* fix link in shortcode

* [DOCS-13183] Update buffer metrics for 2.13 (#34139)

* update metrics and add new ones

* update

* Apply suggestions from code review

Co-authored-by: Jansen <jansenwenb@gmail.com>

* Apply suggestion from @Jansen-w

Co-authored-by: Jansen <jansenwenb@gmail.com>

* Apply suggestions from code review

Co-authored-by: Jansen <jansenwenb@gmail.com>

* add metrics

---------

Co-authored-by: Jansen <jansenwenb@gmail.com>

---------

Co-authored-by: Jansen <jansenwenb@gmail.com>
Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Architecture Everything related to the Doc backend

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants