-
Notifications
You must be signed in to change notification settings - Fork 4.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
HIVE-28292: Optimize SHOW TABLES|VIEWS statements #5273
Conversation
tables = client.getTables("d*", "*"); | ||
Assert.assertEquals("All tables size", 7, tables.size()); | ||
tables = client.getTables("def*", "*"); | ||
Assert.assertEquals("All tables size", 5, tables.size()); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Remove these tests, discussed in #4326 (comment).
@dengzhhu653 @deniskuzZ @zhangbutao Could you please help review this patch? |
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/info/show/tables/ShowTablesFormatter.java
Outdated
Show resolved
Hide resolved
...re/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/utils/MetaStoreUtils.java
Outdated
Show resolved
Hide resolved
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/info/show/tables/ShowTablesOperation.java
Outdated
Show resolved
Hide resolved
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/info/show/tables/ShowTablesOperation.java
Show resolved
Hide resolved
ql/src/test/results/clientpositive/llap/authorization_privilege_objects.q.out
Show resolved
Hide resolved
Quality Gate passedIssues Measures |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, sorry for a few month delay. 1 suggestion on regex simplification
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM +1, pending tests
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/info/show/tables/ShowTablesFormatter.java
Outdated
Show resolved
Hide resolved
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/info/show/tables/ShowTablesFormatter.java
Outdated
Show resolved
Hide resolved
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/info/show/tables/ShowTablesFormatter.java
Outdated
Show resolved
Hide resolved
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/info/show/tables/ShowTablesOperation.java
Outdated
Show resolved
Hide resolved
Quality Gate passedIssues Measures |
What changes were proposed in this pull request?
Make some improvements in
SHOW TABLES
statement:UNIQUETABLE(TBL_NAME, DB_ID)
toUNIQUETABLE (DB_ID, TBL_NAME)
and drop indexTBLS_N49(DB_ID)
Why are the changes needed?
Improve the performance of
SHOW TABLES|VIEWS
statements.Does this PR introduce any user-facing change?
No.
Is the change a dependency upgrade?
No.
How was this patch tested?
Passing existing tests and do benchmark tests.
java -jar hmsbench.jar -H localhost --savedata /tmp/benchdata --sanitize -N 100 -N 10000 -o bench_results.csv -C -d testbench_http --params=100 -M 'listTables.*'