v0.35.2

This is release v0.35.2 of Grafana Agent.

Upgrading

Read the relevant upgrade guides for specific instructions on upgrading from older versions:

• Static mode upgrade guide
• Static mode Kubernetes operator upgrade guide
• Flow mode upgrade guide

Notable changes:

Bugfixes

• Fix issue where the flow mode UI would show an empty page when navigating to
  an unhealthy prometheus.operator component or a healthy
  prometheus.operator component which discovered no custom resources.
  (@rfratto)

• Fix panic when using oauth2 without specifying tls_config. (@mattdurham)

• Fix issue where series records would never get written to the WAL if a scrape
  was rolled back, resulting in "dropped sample for series that was not
  explicitly dropped via relabelling" log messages. (@rfratto)

• Fix RPM file digests so that installation on FIPS-enabled systems succeeds. (@andrewimeson)

Other changes

• Compile journald support into builds of grafana-agentctl so
  grafana-agentctl test-logs functions as expected when testing tailing the
  systemd journal. (@rfratto)

Installation

Refer to our installation guides for how to install the variants of Grafana Agent:

• Install static mode
• Install the static mode Kubernetes operator
• Install flow mode

v0.35.1

This is release v0.35.1 of Grafana Agent.

Upgrading

Read the relevant upgrade guides for specific instructions on upgrading from older versions:

• Static mode upgrade guide
• Static mode Kubernetes operator upgrade guide
• Flow mode upgrade guide

Notable changes:

Bugfixes

• Fix incorrect display of trace IDs in the automatic_logging processor of static mode's traces subsystem.
  Users of the static mode's service_graphs processor are also advised to upgrade,
  although the bug should theoretically not affect them. (@ptodev)

For a full list of changes, please refer to the CHANGELOG!

Installation

Refer to our installation guides for how to install the variants of Grafana Agent:

• Install static mode
• Install the static mode Kubernetes operator
• Install flow mode

v0.35.0

This is release v0.35.0 of Grafana Agent.

Upgrading

Read the relevant upgrade guides for specific instructions on upgrading from older versions:

• Static mode upgrade guide
• Static mode Kubernetes operator upgrade guide
• Flow mode upgrade guide

Notable changes:

BREAKING CHANGES: This release has breaking changes. Please read entries
carefully and consult the upgrade guide for specific instructions.

Breaking changes

• The algorithm for the "hash" action of otelcol.processor.attributes has changed.
  The change was made in PR #22831 of opentelemetry-collector-contrib. (@ptodev)

• otelcol.exporter.loki now includes the instrumentation scope in its output. (@ptodev)

• otelcol.extension.jaeger_remote_sampling removes the / HTTP endpoint. The /sampling endpoint is still functional.
  The change was made in PR #18070 of opentelemetry-collector-contrib. (@ptodev)

• The field version and auth struct block from walk_params in prometheus.exporter.snmp and SNMP integration have been removed. The auth block now can be configured at top level, together with modules (@marctc)

• Rename discovery.file to local.file_match to make it more clear that it
  discovers file on the local filesystem, and so it doesn't get confused with
  Prometheus' file discovery. (@rfratto)

• Remove the discovery_target_decode function in favor of using discovery
  components to better match the behavior of Prometheus' service discovery.
  (@rfratto)

• In the traces subsystem for Static mode, some metrics are removed and others are renamed. (@ptodev)

  • Removed metrics:

    • "blackbox_exporter_config_last_reload_success_timestamp_seconds" (gauge)
    • "blackbox_exporter_config_last_reload_successful" (gauge)
    • "blackbox_module_unknown_total" (counter)
    • "traces_processor_tail_sampling_count_traces_sampled" (counter)
    • "traces_processor_tail_sampling_new_trace_id_received" (counter)
    • "traces_processor_tail_sampling_sampling_decision_latency" (histogram)
    • "traces_processor_tail_sampling_sampling_decision_timer_latency" (histogram)
    • "traces_processor_tail_sampling_sampling_policy_evaluation_error" (counter)
    • "traces_processor_tail_sampling_sampling_trace_dropped_too_early" (counter)
    • "traces_processor_tail_sampling_sampling_traces_on_memory" (gauge)
    • "traces_receiver_accepted_spans" (counter)
    • "traces_receiver_refused_spans" (counter)
    • "traces_exporter_enqueue_failed_log_records" (counter)
    • "traces_exporter_enqueue_failed_metric_points" (counter)
    • "traces_exporter_enqueue_failed_spans" (counter)
    • "traces_exporter_queue_capacity" (gauge)
    • "traces_exporter_queue_size" (gauge)

  • Renamed metrics:

    • "traces_receiver_refused_spans" is renamed to "traces_receiver_refused_spans_total"
    • "traces_receiver_accepted_spans" is renamed to "traces_receiver_refused_spans_total"
    • "traces_exporter_sent_metric_points" is renamed to "traces_exporter_sent_metric_points_total"

• The remote_sampling block has been removed from otelcol.receiver.jaeger. (@ptodev)

Deprecations

• otelcol.exporter.jaeger has been deprecated and will be removed in Agent v0.38.0. (@ptodev)

Features

• The Pyroscope scrape componen2 hours agot computes and sends delta profiles automatically when required to reduce bandwidth usage. (@cyriltovena)

• Support stage.geoip in loki.process. (@akselleirv)

• Integrations: Introduce the squid integration. (@armstrmi)

• Support custom fields in MMDB file for stage.geoip. (@akselleirv)

• Added json_path function to river stdlib. (@jkroepke)

• Add format, join, tp_lower, replace, split, trim, trim_prefix, trim_suffix, trim_space, to_upper functions to river stdlib. (@jkroepke)

• Flow UI: Add a view for listing the Agent's peers status when clustering is enabled. (@tpaschalis)

• Add a new CLI command grafana-agent convert for converting a river file from supported formats to river. (@erikbaranowski)

• Add support to the grafana-agent run CLI for converting a river file from supported formats to river. (@erikbaranowski)

• Add boringcrypto builds and docker images for Linux arm64 and x64. (@mattdurham)

• New Grafana Agent Flow components:

  • discovery.file discovers scrape targets from files. (@spartan0x117)
  • discovery.kubelet collect scrape targets from the Kubelet API. (@gcampbell12)
  • module.http runs a Grafana Agent Flow module loaded from a remote HTTP endpoint. (@spartan0x117)2 hours ago
  • otelcol.processor.attributes accepts telemetry data from other otelcol
    components and modifies attributes of a span, log, or metric. (@ptodev)
  • prometheus.exporter.cloudwatch - scrape AWS CloudWatch metrics (@thepalbi)
  • prometheus.exporter.elasticsearch collects metrics from Elasticsearch. (@marctc)
  • prometheus.exporter.kafka collects metrics from Kafka Server. (@oliver-zhang)
  • prometheus.exporter.mongodb collects metrics from MongoDB. (@marctc)
  • prometheus.exporter.squid collects metrics from a squid server. (@armstrmi)
  • prometheus.operator.probes - discovers Probe resources in your Kubernetes
    cluster and scrape the targets they reference. (@captncraig)
  • pyroscope.ebpf collects system-wide performance profiles from the current
    host (@korniltsev)
  • otelcol.exporter.loadbalancing - export traces and logs to multiple OTLP gRPC
    endpoints in a load-balanced way. (@ptodev)

• New Grafana Agent Flow command line utilities:

  • grafana-agent tools prometheus.remote_write holds a collection of remote
    write-specific tools. These have been ported over from the agentctl command. (@rfratto)

• A new action argument for otelcol.auth.headers. (@ptodev)

• New metadata_keys and metadata_cardinality_limit arguments for otelcol.processor.batch. (@ptodev)

• New boolean_attribute and ottl_condition sampling policies for otelcol.processor.tail_sampling. (@ptodev)

• A new initial_offset argument for otelcol.receiver.kafka. (@ptodev)

Other changes

• Mongodb integration has been re-enabled. (@jcreixell, @marctc)

For a full list of changes, please refer to the CHANGELOG!

Installation

Refer to our installation guides for how to install the variants of Grafana Agent:

• Install static mode
• Install the static mode Kubernetes operator
• Install flow mode

v0.35.0-rc.1

This is release v0.35.0-rc.1 of Grafana Agent.

Upgrading

Read the relevant upgrade guides for specific instructions on upgrading from older versions:

• Static mode upgrade guide
• Static mode Kubernetes operator upgrade guide
• Flow mode upgrade guide

Notable changes:

Features

• Add support for converting Prometheus file_sd_config to discovery.file. (@erikbaranowski)

Bugfixes

• Fix issue where remote.http incorrectly had a status of "Unknown" until the
  period specified by the polling frquency elapsed. (@rfratto)

For a full list of changes, please refer to the CHANGELOG!

Installation

Refer to our installation guides for how to install the variants of Grafana Agent:

• Install static mode
• Install the static mode Kubernetes operator
• Install flow mode

v0.35.0-rc.0

This is release v0.35.0-rc.0 of Grafana Agent.

Upgrading

Read the relevant upgrade guides for specific instructions on upgrading from older versions:

• Static mode upgrade guide
• Static mode Kubernetes operator upgrade guide
• Flow mode upgrade guide

Notable changes:

Breaking changes

• The algorithm for the "hash" action of otelcol.processor.attributes has changed.
  The change was made in PR #22831 of opentelemetry-collector-contrib. (@ptodev)

• otelcol.exporter.loki now includes the instrumentation scope in its output. (@ptodev)

• otelcol.extension.jaeger_remote_sampling removes the / HTTP endpoint. The /sampling endpoint is still functional.
  The change was made in PR #18070 of opentelemetry-collector-contrib. (@ptodev)

• The field version and auth struct block from walk_params in prometheus.exporter.snmp and SNMP integration have been removed. The auth block now can be configured at top level, together with modules (@marctc)

• Rename discovery.file to local.file_match to make it more clear that it
  discovers file on the local filesystem, and so it doesn't get confused with
  Prometheus' file discovery. (@rfratto)

• Remove the discovery_target_decode function in favor of using discovery
  components to better match the behavior of Prometheus' service discovery.
  (@rfratto)

• In the traces subsystem for Static mode, some metrics are removed and others are renamed. (@ptodev)

  • Removed metrics:

    • "blackbox_exporter_config_last_reload_success_timestamp_seconds" (gauge)
    • "blackbox_exporter_config_last_reload_successful" (gauge)
    • "blackbox_module_unknown_total" (counter)
    • "traces_processor_tail_sampling_count_traces_sampled" (counter)
    • "traces_processor_tail_sampling_new_trace_id_received" (counter)
    • "traces_processor_tail_sampling_sampling_decision_latency" (histogram)
    • "traces_processor_tail_sampling_sampling_decision_timer_latency" (histogram)
    • "traces_processor_tail_sampling_sampling_policy_evaluation_error" (counter)
    • "traces_processor_tail_sampling_sampling_trace_dropped_too_early" (counter)
    • "traces_processor_tail_sampling_sampling_traces_on_memory" (gauge)
    • "traces_receiver_accepted_spans" (counter)
    • "traces_receiver_refused_spans" (counter)
    • "traces_exporter_enqueue_failed_log_records" (counter)
    • "traces_exporter_enqueue_failed_metric_points" (counter)
    • "traces_exporter_enqueue_failed_spans" (counter)
    • "traces_exporter_queue_capacity" (gauge)
    • "traces_exporter_queue_size" (gauge)

  • Renamed metrics:

    • "traces_receiver_refused_spans" is renamed to "traces_receiver_refused_spans_total"
    • "traces_receiver_accepted_spans" is renamed to "traces_receiver_refused_spans_total"
    • "traces_exporter_sent_metric_points" is renamed to "traces_exporter_sent_metric_points_total"

• The remote_sampling block has been removed from otelcol.receiver.jaeger. (@ptodev)

Deprecations

• otelcol.exporter.jaeger has been deprecated and will be removed in Agent v0.38.0. (@ptodev)

Features

• The Pyroscope scrape component computes and sends delta profiles automatically when required to reduce bandwidth usage. (@cyriltovena)

• Support stage.geoip in loki.process. (@akselleirv)

• Integrations: Introduce the squid integration. (@armstrmi)

• Support custom fields in MMDB file for stage.geoip. (@akselleirv)

• Added json_path function to river stdlib. (@jkroepke)

• Add format, join, tp_lower, replace, split, trim, trim_prefix, trim_suffix, trim_space, to_upper functions to river stdlib. (@jkroepke)

• Flow UI: Add a view for listing the Agent's peers status when clustering is enabled. (@tpaschalis)

• Add a new CLI command grafana-agent convert for converting a river file from supported formats to river. (@erikbaranowski)

• Add support to the grafana-agent run CLI for converting a river file from supported formats to river. (@erikbaranowski)

• Add boringcrypto builds and docker images for Linux arm64 and x64. (@mattdurham)

• New Grafana Agent Flow components:

  • discovery.file discovers scrape targets from files. (@spartan0x117)
  • discovery.kubelet collect scrape targets from the Kubelet API. (@gcampbell12)
  • module.http runs a Grafana Agent Flow module loaded from a remote HTTP endpoint. (@spartan0x117)
  • otelcol.processor.attributes accepts telemetry data from other otelcol
    components and modifies attributes of a span, log, or metric. (@ptodev)
  • prometheus.exporter.cloudwatch - scrape AWS CloudWatch metrics (@thepalbi)
  • prometheus.exporter.elasticsearch collects metrics from Elasticsearch. (@marctc)
  • prometheus.exporter.kafka collects metrics from Kafka Server. (@oliver-zhang)
  • prometheus.exporter.mongodb collects metrics from MongoDB. (@marctc)
  • prometheus.exporter.squid collects metrics from a squid server. (@armstrmi)
  • prometheus.operator.probes - discovers Probe resources in your Kubernetes
    cluster and scrape the targets they reference. (@captncraig)
  • pyroscope.ebpf collects system-wide performance profiles from the current
    host (@korniltsev)
  • otelcol.exporter.loadbalancing - export traces and logs to multiple OTLP gRPC
    endpoints in a load-balanced way. (@ptodev)

• New Grafana Agent Flow command line utilities:

  • grafana-agent tools prometheus.remote_write holds a collection of remote
    write-specific tools. These have been ported over from the agentctl command. (@rfratto)

• A new action argument for otelcol.auth.headers. (@ptodev)

• New metadata_keys and metadata_cardinality_limit arguments for otelcol.processor.batch. (@ptodev)

• New boolean_attribute and ottl_condition sampling policies for otelcol.processor.tail_sampling. (@ptodev)

• A new initial_offset argument for otelcol.receiver.kafka. (@ptodev)

For a full list of changes, please refer to the CHANGELOG!

Installation

Refer to our installation guides for how to install the variants of Grafana Agent:

• Install static mode
• Install the static mode Kubernetes operator
• Install flow mode

v0.34.3

This is release v0.34.3 of Grafana Agent.

Upgrading

Read the relevant upgrade guides for specific instructions on upgrading from older versions:

• Static mode upgrade guide
• Static mode Kubernetes operator upgrade guide
• Flow mode upgrade guide

Notable changes:

Bugfixes

• Fixes a bug in conversion of OpenTelemetry histograms when exported to Prometheus. (@grcevski)
• Enforce sha256 digest signing for rpms enabling installation on FIPS-enabled OSes. (@kfriedrich123)
• Fix panic from improper startup ordering in prometheus.operator.servicemonitors. (@captncraig)

Installation

Refer to our installation guides for how to install the variants of Grafana Agent:

• Install static mode
• Install the static mode Kubernetes operator
• Install Flow mode

v0.34.2

This is release v0.34.2 of Grafana Agent.

Upgrading

Read the relevant upgrade guides for specific instructions on upgrading from older versions:

• Static mode upgrade guide
• Static mode Kubernetes operator upgrade guide
• Flow mode upgrade guide

Notable changes:

Enhancements

• Replace map cache in prometheus.relabel with an LRU cache. (@mattdurham)
• Integrations: Extend statsd integration to configure relay endpoint. (@arminaaki)

Bugfixes

• Fix a bug where prometheus.relabel would not correctly relabel when there is a cache miss. (@thampiotr)
• Fix a bug where prometheus.relabel would not correctly relabel exemplars or metadata. (@tpaschalis)
• Fixes several issues with statsd exporter. (@jcreixell, @marctc)

Other changes

• Mongodb integration has been disabled for the time being due to licensing issues. (@jcreixell)

Installation

Refer to our installation guides for how to install the variants of Grafana Agent:

• Install static mode
• Install the static mode Kubernetes operator
• Install Flow mode

v0.34.1

This is release v0.34.1 of Grafana Agent.

Upgrading

Read the relevant upgrade guides for specific instructions on upgrading from older versions:

• Static mode upgrade guide
• Static mode Kubernetes operator upgrade guide
• Flow mode upgrade guide

Notable changes:

Bugfixes

• Fixed application of sub-collector defaults using the windows_exporter integration or prometheus.exporter.windows. (@mattdurham)

• Fix issue where remote.http did not fail early if the initial request
  failed. This caused failed requests to initially export empty values, which
  could lead to propagating issues downstream to other components which expect
  the export to be non-empty. (@rfratto)

• Allow bearerTokenFile field to be used in ServiceMonitors. (@captncraig)

Installation

Refer to our installation guides for how to install the variants of Grafana Agent:

• Install static mode
• Install the static mode Kubernetes operator
• Install Flow mode

v0.34.0

This is release v0.34.0 of Grafana Agent.

Upgrading

Read the relevant upgrade guides for specific instructions on upgrading from older versions:

• Static mode upgrade guide
• Static mode Kubernetes operator upgrade guide
• Flow mode upgrade guide

Notable changes:

Breaking changes

• The experimental dynamic configuration feature has been removed in favor of Flow mode. (@mattdurham)

• The oracledb integration configuration has removed a redundant field metrics_scrape_interval. Use the scrape_interval parameter of the integration if a custom scrape interval is required. (@schmikei)

• Upgrade the embedded windows_exporter to commit 79781c6. (@jkroepke)

• Prometheus exporters in Flow mode now set the instance label to a value similar to the one they used to have in Static mode ( by default, customized by some integrations). (@jcreixell)

• phlare.scrape and phlare.write have been renamed to pyroscope.scrape and pyroscope.scrape. (@korniltsev)

Features

• New Grafana Agent Flow components:

  • loki.source.api - receive Loki log entries over HTTP (e.g. from other agents). (@thampiotr)
  • prometheus.operator.servicemonitors discovers ServiceMonitor resources in your Kubernetes cluster and scrape
    the targets they reference. (@captncraig, @marctc, @jcreixell)
  • prometheus.receive_http - receive Prometheus metrics over HTTP (e.g. from other agents). (@thampiotr)
  • remote.vault retrieves a secret from Vault. (@rfratto)
  • prometheus.exporter.snowflake collects metrics from a snowflake database (@JonathanWamsley)
  • prometheus.exporter.mssql collects metrics from Microsoft SQL Server (@JonathanWamsley)
  • prometheus.exporter.oracledb collects metrics from oracledb (@JonathanWamsley)
  • prometheus.exporter.dnsmasq collects metrics from a dnsmasq server. (@spartan0x117)
  • loki.source.awsfirehose - receive Loki log entries from AWS Firehose via HTTP (@thepalbi)

• Added new functions to the River standard library:

  • coalesce returns the first non-zero value from a list of arguments. (@jkroepke)
  • nonsensitive converts a River secret back into a string. (@rfratto)

For a full list of changes, please refer to the CHANGELOG!

Installation

Refer to our installation guides for how to install the variants of Grafana Agent:

• Install static mode
• Install the static mode Kubernetes operator
• Install Flow mode

v0.34.0-rc.2

This is release v0.34.0-rc.2 of Grafana Agent.

Upgrading

Read the relevant upgrade guides for specific instructions on upgrading from older versions:

• Static mode upgrade guide
• Static mode Kubernetes operator upgrade guide
• Flow mode upgrade guide

Notable changes:

Enhancements

• prometheus.operator.podmonitors and prometheus.operator.servicemonitors can now access cluster secrets for authentication to targets. (@captncraig)

Bugfixes

• Add signing region to remote.s3 component for use with custom endpoints so that Authorization Headers work correctly when
  proxying requests. (@mattdurham)

• Fix missing instance key for prometheus.exporter.dnsmasq component. (@spartan0x117)

Installation

Refer to our installation guides for how to install the variants of Grafana Agent:

• Install static mode
• Install the static mode Kubernetes operator
• Install Flow mode