Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Skip writeback for chunks fetched by queriers older than a duration #15393

Closed
wants to merge 104 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
104 commits
Select commit Hold shift + click to select a range
516e84c
feat: Skip writeback for chunks fetched by queriers older than a dura…
mveitas Dec 12, 2024
7d7e1a3
Updating docs
mveitas Dec 12, 2024
b431992
Remove filtering of chunks
mveitas Dec 12, 2024
f4ced87
Remove unrelated changes
mveitas Dec 18, 2024
96bc632
fix(deps): update module golang.org/x/crypto to v0.31.0 [security] (#…
renovate[bot] Dec 12, 2024
79a6fe7
ci: disable renovate toolchain updates (#15279)
trevorwhitney Dec 12, 2024
4c3a5f0
chore(deps): bump golang.org/x/crypto from 0.26.0 to 0.31.0 in /cmd/c…
dependabot[bot] Dec 12, 2024
abd2aa8
fix(deps): update module github.com/heroku/x to v0.4.1 (#15370)
renovate[bot] Dec 12, 2024
a6bd054
feat(lambda-promtail): Add terraform variable for s3 bucket notificat…
milenpankov-bosch Dec 12, 2024
80535eb
fix(deps): update module github.com/grpc-ecosystem/go-grpc-middleware…
renovate[bot] Dec 12, 2024
f6fbc9a
fix(ci): transform TestChunkSize into a benchmark (#15361)
na-- Dec 12, 2024
5873150
fix(deps): update module github.com/ibm/go-sdk-core/v5 to v5.18.2 (#1…
renovate[bot] Dec 12, 2024
6792ceb
fix(deps): update module github.com/pierrec/lz4/v4 to v4.1.22 (#15400)
renovate[bot] Dec 12, 2024
db936d8
fix(deps): update module k8s.io/apimachinery to v0.32.0 (#15398)
renovate[bot] Dec 13, 2024
ab76069
fix: Return error 422 (Unprocessable Content) when push request does …
ravishankar15 Dec 13, 2024
eb8da20
fix(helm): Add conditional to include ruler config only when enabled …
Tostaza Dec 13, 2024
b336b7f
fix(azureblob): Return error if Azure returns no service principal to…
rgroothuijsen Dec 13, 2024
880aa41
fix(ci): Fix test compile error (#15404)
chaudum Dec 13, 2024
2bc04ac
chore: Fix wording in Loki Operator ADOPTERS.md files (#15406)
chaudum Dec 13, 2024
917a461
chore: Introduce back phase for kafka delay metrics (#15407)
cyriltovena Dec 13, 2024
9c4ac59
chore(block-scheduler): add scheduler grpc methods to auth mw ignore …
ashwanthgoli Dec 13, 2024
6a78b3b
fix(block-scheduler): init record planner correctly (#15390)
ashwanthgoli Dec 13, 2024
1b45d06
chore: Reverting #11506 (#15409)
slim-bean Dec 13, 2024
f6d70ce
docs: Update LogCLI topic (#15376)
JStickler Dec 13, 2024
ee79680
fix: data race / nil channel read in pattern aggregation push (#15410)
na-- Dec 13, 2024
399ffb0
chore(deps): update module golang.org/x/crypto to v0.31.0 [security] …
renovate[bot] Dec 13, 2024
cf67a62
chore(deps): update anchore/sbom-action action to v0.17.9 (#15414)
renovate[bot] Dec 13, 2024
0fbc0ae
fix(deps): update module github.com/golang/snappy to v0.0.4 (#15415)
renovate[bot] Dec 13, 2024
acb7b92
fix(deps): update module github.com/ibm/go-sdk-core/v5 to v5.18.3 (#1…
renovate[bot] Dec 14, 2024
543eaae
fix(ci): Update Python version for Helm CI (#15420)
GVengelen Dec 16, 2024
3bbb741
fix: data race in distributor tests (#15423)
na-- Dec 16, 2024
dd1f4bf
feat: line_format bypass template execution if possible (#15411)
cyriltovena Dec 16, 2024
8b171a6
fix(deps): Downgrade hyperloglog to 0.2.0 (#15424) (#15426)
chaudum Dec 16, 2024
9205ff2
docs: add deploy preview (#15403)
robbymilo Dec 16, 2024
eb99ec5
fix: remove unsafe pkg usage from util.mempool (#15428)
na-- Dec 16, 2024
ab70b9b
chore(block-scheduler): planner improvements to limit jobs and consid…
ashwanthgoli Dec 17, 2024
ddc9920
chore(deps): update terraform google to v6.14.0 (#15443)
renovate[bot] Dec 17, 2024
d916087
chore(deps): update terraform aws to ~> 5.81.0 (#15442)
renovate[bot] Dec 17, 2024
1bafc46
fix(deps): update module github.com/baidubce/bce-sdk-go to v0.9.208 (…
renovate[bot] Dec 17, 2024
2527c66
docs: fix docs for bloom filters query acceleration hyperlink (#15438)
elburnetto-intapp Dec 17, 2024
d93d605
docs: adding exceptions to Vale rule (#15431)
JStickler Dec 17, 2024
aec6ef6
fix(deps): update module github.com/minio/minio-go/v7 to v7.0.82 (#15…
renovate[bot] Dec 17, 2024
556b4ad
docs: add URL to Log entry deletion page (#9119)
sarah-spang Dec 17, 2024
696b582
ci: fix the docker driver build (#15354)
trevorwhitney Dec 18, 2024
ec8eeab
fix: data race in ingester test (#15465)
na-- Dec 18, 2024
6621d2c
feat(api): Support Parquet as a query response format. (#15408)
jeschkies Dec 18, 2024
23ea689
docs: add exception to spelling rule (#15463)
JStickler Dec 18, 2024
da6aeb7
docs: fixing broken command (#15457)
JStickler Dec 18, 2024
6ea761e
docs: fix admonition, line spacing (#15462)
JStickler Dec 18, 2024
ec23bd9
chore(deps): Update Thanos library (#15483)
paul1r Dec 18, 2024
0bd88e6
chore: Update ASCII diagram of chunk binary encoding (#15386)
chaudum Dec 18, 2024
2e5972a
fix: data race in chunk client hedging tests (#15466)
na-- Dec 18, 2024
f3be2ae
docs: update docker-driver image reference (#15485)
trevorwhitney Dec 18, 2024
cf6df92
fix(deps): update module google.golang.org/api to v0.213.0 (#15455)
renovate[bot] Dec 18, 2024
a3c12ea
fix(deps): update module github.com/klauspost/compress to v1.17.11 (#…
renovate[bot] Dec 18, 2024
513cbfc
ci: remove test step from nix-ci (#15491)
trevorwhitney Dec 18, 2024
e01ea5c
chore: release loki helm chart 6.24.0 (#15435)
loki-gh-app[bot] Dec 19, 2024
b7cdba3
fix(deps): update module golang.org/x/net to v0.33.0 [security] (#15490)
renovate[bot] Dec 19, 2024
dee5e19
chore(deps): update helm release rollout-operator to v0.22.0 (#15419)
renovate[bot] Dec 19, 2024
86e90b0
fix(deps): update module github.com/influxdata/telegraf to v1.33.0 (#…
renovate[bot] Dec 19, 2024
4765441
fix(deps): update module go.opentelemetry.io/collector/pdata to v1.22…
renovate[bot] Dec 19, 2024
e25750c
fix(deps): update module go.opentelemetry.io/otel/trace to v1.33.0 (#…
renovate[bot] Dec 19, 2024
61c4fbd
fix(ci): Remove submodule once and for all (#15495)
chaudum Dec 19, 2024
5229362
perf: Improve `approx_topk` performance by reducing allocations. (#15…
jeschkies Dec 19, 2024
3ce3b9f
test: Increase buffer size to prevent timeouts in tests (#15498)
paul1r Dec 19, 2024
1a8897c
chore(deps): update terraform google to v6.14.1 (#15493)
renovate[bot] Dec 19, 2024
cd744d9
fix(deps): update module github.com/alicebob/miniredis/v2 to v2.34.0 …
renovate[bot] Dec 19, 2024
91d442b
chore(deps): update helm/kind-action action to v1.11.0 (#15494)
renovate[bot] Dec 19, 2024
9a8f5bf
fix(deps): update module github.com/pierrec/lz4 to v2.6.1+incompatibl…
renovate[bot] Dec 19, 2024
6fc6d14
fix(blooms): Match series to newest block only (#15481)
chaudum Dec 19, 2024
24646b8
chore(deps): update logstash docker tag to v8.17.0 (#15500)
renovate[bot] Dec 19, 2024
49e45e4
fix(ci): Revert "fixed `Publish Rendered Helm Chart Diff` workflow" (…
edspace Dec 20, 2024
4b31898
docs: Loki 3.3.2 Release Notes (#15487)
JStickler Dec 20, 2024
083ca0e
chore(deps): update terraform aws to ~> 5.82.0 (#15517)
renovate[bot] Dec 20, 2024
e1a2374
fix(deps): update module github.com/axiomhq/hyperloglog to v0.2.2 (#1…
renovate[bot] Dec 20, 2024
bf99303
fix(deps): update module github.com/baidubce/bce-sdk-go to v0.9.209 (…
renovate[bot] Dec 20, 2024
6b3e873
chore(deps): update fluent/fluent-bit docker tag to v3.2.3 (#15507)
renovate[bot] Dec 20, 2024
d83673a
fix(deps): update module github.com/aws/aws-sdk-go-v2/config to v1.28…
renovate[bot] Dec 20, 2024
a602100
fix(deps): update module github.com/aws/aws-sdk-go-v2/service/s3 to v…
renovate[bot] Dec 20, 2024
8dab51d
fix(deps): update module google.golang.org/api to v0.214.0 (#15519)
renovate[bot] Dec 20, 2024
24e25d2
fix: structured metadata not always passed down for processing delete…
slim-bean Dec 20, 2024
99fe867
fix(lambda-promtail): Remove s3 bucket ownership verification (#15383)
milenpankov-bosch Dec 23, 2024
c85ce9c
fix(blockbuilder): copy entries returned by record decoder (#15549)
ashwanthgoli Dec 27, 2024
dde228f
chore: add status page for block scheduler (#15553)
ashwanthgoli Dec 27, 2024
82945c2
fix(deps): update module github.com/sony/gobreaker/v2 to v2.1.0 (#15556)
renovate[bot] Dec 30, 2024
b098c33
fix(deps): update module github.com/ibm/sarama to v1.44.0 (#15552)
renovate[bot] Dec 30, 2024
12d3f75
fix(deps): update module github.com/hashicorp/consul/api to v1.31.0 (…
renovate[bot] Dec 30, 2024
e130656
fix(deps): update module cloud.google.com/go/storage to v1.49.0 (#15529)
renovate[bot] Dec 30, 2024
e39260b
fix(deps): update module google.golang.org/protobuf to v1.36.1 (#15539)
renovate[bot] Dec 30, 2024
0541f73
chore(block-builder): update block builder to use kafka clients direc…
ashwanthgoli Dec 30, 2024
9576c98
feat(block-scheduler): introduce job lease and requeue expired jobs (…
ashwanthgoli Dec 30, 2024
852ffec
chore(deps): update fluent/fluent-bit docker tag to v3.2.4 (#15564)
renovate[bot] Dec 31, 2024
49e54bb
chore(deps): update ruby docker tag to v3.4.1 (#15551)
renovate[bot] Dec 31, 2024
67be896
chore(make): loki-local-image make target for building images on loca…
owen-d Dec 31, 2024
05fb6ce
fix: do not retain copy of chunk while indexing a new chunk in tsdb w…
sandeepsukhani Jan 2, 2025
03b4bdc
fix(deps): update module github.com/baidubce/bce-sdk-go to v0.9.211 (…
renovate[bot] Jan 2, 2025
d00a74c
fix(deps): update module github.com/shirou/gopsutil/v4 to v4.24.12 (#…
renovate[bot] Jan 2, 2025
9ce6697
fix(deps): update module cloud.google.com/go/bigtable to v1.34.0 (#15…
renovate[bot] Jan 3, 2025
27793ff
chore(deps): update prom/prometheus docker tag to v3.1.0 (#15575)
renovate[bot] Jan 3, 2025
cc9a3dc
feat(block-scheduler): status page shows completed jobs (#15580)
owen-d Jan 3, 2025
dcc0007
fix: bytes unit detection in detected fields (#15525)
trevorwhitney Jan 4, 2025
479a2c3
fix(block-scheduler): one job per partition (local branch copy) (#15579)
owen-d Jan 6, 2025
f0375ce
feat: add kafka development environment (#15603)
cyriltovena Jan 6, 2025
1033274
Revert removal of optimization
mveitas Jan 6, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion .github/jsonnetfile.json
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@
"subdir": "workflows"
}
},
"version": "21f1189544e3976070cbdb6463f64c7a32dcc176"
"version": "cfa24256090828f566f1ba59292ce65d8db4a4ae"
}
],
"legacyImports": true
Expand Down
4 changes: 2 additions & 2 deletions .github/jsonnetfile.lock.json
Original file line number Diff line number Diff line change
Expand Up @@ -8,8 +8,8 @@
"subdir": "workflows"
}
},
"version": "21f1189544e3976070cbdb6463f64c7a32dcc176",
"sum": "IPS1oGR8k7jk6J2snciTycWFgtISCwXSPhJ3A+nEGvY="
"version": "cfa24256090828f566f1ba59292ce65d8db4a4ae",
"sum": "tml1dcFlo15kEE6JvN/nPY2xkhfeF3ERZjAyFbnguHA="
}
],
"legacyImports": false
Expand Down
19 changes: 9 additions & 10 deletions .github/release-workflows.jsonnet
Original file line number Diff line number Diff line change
@@ -1,9 +1,14 @@
local lokiRelease = import 'workflows/main.jsonnet';
local build = lokiRelease.build;

local build = lokiRelease.build;
local releaseLibRef = 'main';

local checkTemplate = 'grafana/loki-release/.github/workflows/check.yml@%s' % releaseLibRef;
local buildImageVersion = std.extVar('BUILD_IMAGE_VERSION');
local buildImage = 'grafana/loki-build-image:%s' % buildImageVersion;
local golangCiLintVersion = 'v1.60.3';
local imageBuildTimeoutMin = 60;
local imagePrefix = 'grafana';
local dockerPluginDir = 'clients/cmd/docker-driver';

local imageJobs = {
loki: build.image('loki', 'cmd/loki'),
Expand All @@ -15,7 +20,7 @@ local imageJobs = {
'loki-canary-boringcrypto': build.image('loki-canary-boringcrypto', 'cmd/loki-canary-boringcrypto'),
promtail: build.image('promtail', 'clients/cmd/promtail'),
querytee: build.image('loki-query-tee', 'cmd/querytee', platform=['linux/amd64']),
'loki-docker-driver': build.dockerPlugin('grafana/loki-docker-driver', 'clients/cmd/docker-driver', platform=['linux/amd64', 'linux/arm64']),
'loki-docker-driver': build.dockerPlugin('loki-docker-driver', dockerPluginDir, buildImage=buildImage, platform=['linux/amd64', 'linux/arm64']),
};

local weeklyImageJobs = {
Expand All @@ -25,13 +30,6 @@ local weeklyImageJobs = {
promtail: build.weeklyImage('promtail', 'clients/cmd/promtail'),
};

local buildImageVersion = std.extVar('BUILD_IMAGE_VERSION');
local buildImage = 'grafana/loki-build-image:%s' % buildImageVersion;
local golangCiLintVersion = 'v1.60.3';

local imageBuildTimeoutMin = 60;
local imagePrefix = 'grafana';

{
'patch-release-pr.yml': std.manifestYamlDoc(
lokiRelease.releasePRWorkflow(
Expand Down Expand Up @@ -77,6 +75,7 @@ local imagePrefix = 'grafana';
getDockerCredsFromVault=true,
imagePrefix='grafana',
releaseLibRef=releaseLibRef,
pluginBuildDir=dockerPluginDir,
releaseRepo='grafana/loki',
useGitHubAppToken=true,
), false, false
Expand Down
2 changes: 1 addition & 1 deletion .github/renovate.json5
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@
{
// Disable Go version updates
"matchManagers": ["gomod"],
"matchPackageNames": ["go"],
"matchPackageNames": ["go", "toolchain"],
"enabled": false
},
{
Expand Down

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion .github/workflows/check.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
"check":
"uses": "grafana/loki-release/.github/workflows/check.yml@main"
"with":
"build_image": "grafana/loki-build-image:0.34.1"
"build_image": "grafana/loki-build-image:0.34.3"
"golang_ci_lint_version": "v1.60.3"
"release_lib_ref": "main"
"skip_validation": false
Expand Down
Loading
Loading