Skip to content

Conversation

@alamb
Copy link
Contributor

@alamb alamb commented Oct 22, 2025

Which issue does this PR close?

Rationale for this change

As we spend more effort optimizing the number of IO requests made during various scenarios, we need to ensure we have test coverage to:

  1. Verify that the optimizations are working as intended
  2. Prevent regressions in the future as code changes are made

What changes are included in this PR?

Add a new integration test that verifies what IO operations happen when creating and querying listing tables

Are these changes tested?

It is all tests

Are there any user-facing changes?

No, only tests

@github-actions github-actions bot added core Core DataFusion crate execution Related to the execution crate labels Oct 22, 2025
@alamb alamb force-pushed the alamb/object_store_trace_tests branch 3 times, most recently from b2924b7 to 3db4b0e Compare October 24, 2025 19:20
@github-actions github-actions bot removed the execution Related to the execution crate label Oct 24, 2025
@alamb alamb force-pushed the alamb/object_store_trace_tests branch from 3db4b0e to ba4e802 Compare October 24, 2025 19:48
@alamb alamb changed the title WIP: Add integration test for IO operations for listing tables queries Add integration test for IO operations for listing tables queries Oct 24, 2025
@alamb alamb marked this pull request as ready for review October 24, 2025 19:49
@alamb alamb force-pushed the alamb/object_store_trace_tests branch from ba4e802 to 981bc5c Compare October 24, 2025 19:50
@r"
RequestCountingObjectStore()
Total Requests: 2
- HEAD path=csv_table.csv
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the idea is here we can see what object store requests are made for various operations

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core Core DataFusion crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant