Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add test of out of order UploadPart #7047

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

tustvold
Copy link
Contributor

Which issue does this PR close?

Closes #.

Rationale for this change

There have been various rumblings about concurrency issues related to multipart upload, this is my unsuccessful attempt to create a reproducer.

What changes are included in this PR?

Are there any user-facing changes?

@github-actions github-actions bot added the object-store Object Store Interface label Jan 30, 2025
@tustvold tustvold added the development-process Related to development process of arrow-rs label Jan 30, 2025
Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @tustvold

let fut1 = multipart_upload.put_part(part1.into());
let fut2 = multipart_upload.put_part(part2.into());
let fut3 = multipart_upload.put_part(part3.into());
fut2.await.unwrap();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I missed the out of order part of the first read of this PR. Maybe a comment would help:

Suggested change
fut2.await.unwrap();
// note order is 2,3,1 , different than the parts were created in
fut2.await.unwrap();

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
development-process Related to development process of arrow-rs object-store Object Store Interface
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants