Skip to content

SEA: Normalise Columns returned by Metadata Queries #627

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 315 commits into
base: sea-migration
Choose a base branch
from
Draft

SEA: Normalise Columns returned by Metadata Queries #627

wants to merge 315 commits into from
+386 −2

Conversation

varun-edachali-dbx
Copy link
Collaborator

What type of PR is this?

  • Feature

Description

WIP

How is this tested?

  • Unit tests
  • E2E Tests
  • Manually
  • N/A

Related Tickets & Documents

@varun-edachali-dbx
backend from cloudfetch-sea
e385d5b 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
remove filtering, metadata ops
484064e 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
raise NotImplementedErrror for metadata ops
030edf8 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
align SeaResultSet with new structure
4e07f1e 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
correct sea res set tests
65e7c6b 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
add metadata commands
30f8266 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
formatting (black)
033ae73 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
add metadata command unit tests
33821f4 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
minimal fetch phase intro
71b451a 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
Merge branch 'exec-resp-norm' into fetch-json-inline
170f339
@varun-edachali-dbx
Merge branch 'sea-res-set' into fetch-json-inline
40f79b5
@varun-edachali-dbx
working JSON + INLINE
c038d5a 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
change to valid table name
3e22c6c 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
rmeove redundant queue init
716304b 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
large query results
e96e5b8 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
Merge branch 'sea-migration' into sea-test-scripts
787f1f7
@varun-edachali-dbx
remove un-necessary changes
165c4f3 
covered by #588

Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
simplify test module
a6e40d0 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
logging -> debug level
52e3088 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
change table name in log
641c09b 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
Merge branch 'sea-migration' into exec-models-sea
8bd12d8
@varun-edachali-dbx
remove un-necessary changes
ffded6e 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
remove un-necessary backend cahnges
227f6b3 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
remove un-needed GetChunksResponse
68657a3 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
remove un-needed GetChunksResponse
3940eec 
only relevant in Fetch phase

Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
reduce code duplication in response parsing
37813ba 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
reduce code duplication
267c9f4 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
more clear docstrings
2967119 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
introduce strongly typed ChunkInfo
47fd60d 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
remove is_volume_operation from response
982fdf2 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
formatting (black)
8f12c33 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
Merge branch 'sea-migration' into ext-links-sea
ed4d7ab
@varun-edachali-dbx
align with old impl
a5e9cdf 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
align next_n_rows with prev imple
be16634 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
align remaining_rows with prev impl
6ec8656 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
remove un-necessary Optional params
7ea7b75 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
remove un-necessary changes in thrift field if tests
64be07b 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
remove unused imports
165644c 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
run large queries
abef941 
Signed-off-by: varun-edachali-dbx <[email protected]>
@varun-edachali-dbx
Merge branch 'ext-links-sea' into sea-norm-cols
e939d9e
@varun-edachali-dbx varun-edachali-dbx mentioned this pull request Jul 16, 2025
Draft
11 tasks
@varun-edachali-dbx varun-edachali-dbx changed the base branch from ext-links-sea to sea-migration July 19, 2025 07:50
@varun-edachali-dbx
test_get_catalogs
004bcce 
Signed-off-by: varun-edachali-dbx <[email protected]>
@databricks databricks deleted a comment from github-actions bot Jul 19, 2025
@databricks databricks deleted a comment from github-actions bot Jul 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@varun-edachali-dbx