Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add storageID to gc manager #8684

Open
wants to merge 8 commits into
base: master
Choose a base branch
from

Conversation

nadavsteindler
Copy link
Contributor

@nadavsteindler nadavsteindler commented Feb 18, 2025

Closes #8685

Change Description

Add StorageID to GarbageCollectionManager.

Testing

Can test with local lakefs + S3
See SGC acceptance tests repo generation here
Use the sparkless gc container- check that it identifies the correct commits
Run this flow for empty and non-empty storageID cases

@nadavsteindler nadavsteindler added the exclude-changelog PR description should not be included in next release changelog label Feb 18, 2025
@nadavsteindler nadavsteindler self-assigned this Feb 18, 2025
Copy link

E2E Test Results - DynamoDB Local - Local Block Adapter

14 passed

Copy link

E2E Test Results - Quickstart

11 passed

@nadavsteindler nadavsteindler force-pushed the fix/support-storageid-in-garbagecollectionmanager branch from 0906d85 to 4423b73 Compare February 19, 2025 13:18
@nadavsteindler nadavsteindler marked this pull request as draft February 19, 2025 14:46
@nadavsteindler nadavsteindler marked this pull request as ready for review February 23, 2025 11:55
Copy link
Contributor

@itaigilo itaigilo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking great.

"github.com/treeverse/lakefs/pkg/graveler"
"github.com/treeverse/lakefs/pkg/graveler/retention"
"github.com/treeverse/lakefs/pkg/graveler/testutil"
)

var cases = []struct {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔥

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
exclude-changelog PR description should not be included in next release changelog
Projects
None yet
Development

Successfully merging this pull request may close these issues.

GC storageID support
2 participants