Skip to content

Conversation

@colinmarc
Copy link
Contributor

This logic would previously swallow all errors, including things like DNS resolution failures. If the path was indeed a path and not a prefix, that would result in the path being dropped, since the prefix wouldn't include any further files.

Fixes #18242.

@github-actions github-actions bot added the datasource Changes to the datasource crate label Oct 24, 2025
Copy link
Contributor

@Jefffrey Jefffrey left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would it be possible to add a test for this, perhaps at the bottom of the same file?

This logic would previously swallow all errors, including things like
DNS resolution failures. If the path was indeed a path and not a prefix,
that would result in the path being dropped, since the prefix wouldn't
include any further files.

Fixes apache#18242.
@colinmarc
Copy link
Contributor Author

Done, but it made the tests a lot more complicated.

Copy link
Contributor

@Jefffrey Jefffrey left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Fyi @xiedeyantu

@alamb
Copy link
Contributor

alamb commented Oct 24, 2025

Thank you @colinmarc and @Jefffrey

@alamb alamb added this pull request to the merge queue Oct 24, 2025
Merged via the queue into apache:main with commit 987f333 Oct 24, 2025
28 checks passed
@colinmarc colinmarc mentioned this pull request Oct 27, 2025
26 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

datasource Changes to the datasource crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ListingTable silently drops paths when given many files

3 participants