Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Storage Lifecycle Service: support new AWS s3 parameter of lifecycle configuration to move files of any sizes #3753

Open
SilinPavel opened this issue Oct 24, 2024 · 0 comments
Open

Storage Lifecycle Service: support new AWS s3 parameter of lifecycle configuration to move files of any sizes #3753

SilinPavel opened this issue Oct 24, 2024 · 0 comments
Labels
kind/enhancement New feature or request

Comments

@SilinPavel
Copy link
Member

SilinPavel commented Oct 24, 2024 •
edited
Loading

Background

Related to #2721

Based on https://docs.aws.amazon.com/AmazonS3/latest/userguide/lifecycle-transition-general-considerations.html#lifecycle-configuration-constraints
Starting from September 2024 we can control size of the files which will be moved to archive classes.

Approach

  • Introduce new property minimum_object_size_for_transit of cloud region sls properties.
  • During sls execution cycle support usage of this property:
    • If exists and >= 0 use i as ObjectSizeGreaterThan param value for S3 Bucket LifecycleConfiguration
    • If doesn't exists do not specify ObjectSizeGreaterThan param which effectively leads to effect that files < 128Kb won't be transitioned
@SilinPavel SilinPavel added the kind/enhancement New feature or request label Oct 24, 2024
SilinPavel added a commit that referenced this issue Oct 24, 2024
@SilinPavel
issue #3753: introduce usage of minimum_object_size_for_transit prope…
5bb799e 
…rty from sls cloud region config. Expand exception logging.
@SilinPavel SilinPavel mentioned this issue Oct 24, 2024
Merged
SilinPavel added a commit that referenced this issue Oct 24, 2024
@SilinPavel
issue #3753: introduce usage of minimum_object_size_for_transit prope…
915320f 
…rty from sls cloud region config. Expand exception logging.
SilinPavel added a commit that referenced this issue Oct 24, 2024
@SilinPavel
Issue #3753 sls min object size to transit (#3754)
4c537d3
SilinPavel added a commit that referenced this issue Oct 25, 2024
@SilinPavel
Issue #3753: SLS logs update
c43d314
SilinPavel added a commit that referenced this issue Oct 25, 2024
@SilinPavel
Issue #3753: add test cases to check that 0 size files aren't taken f…
f1d5fa3 
…or transit
SilinPavel added a commit that referenced this issue Oct 25, 2024
@SilinPavel
Issue #3753 SLS: fix for function prepare_bucket_if_needed - add old …
236afd2 
…lifecycle rule to the list of new rules to apply if it matches a new one
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
kind/enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@SilinPavel