Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix application qps quota stalls. #14859

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

bziobrowski
Copy link
Contributor

PR fixes #14852.

@codecov-commenter
Copy link

codecov-commenter commented Jan 21, 2025

Codecov Report

Attention: Patch coverage is 75.00000% with 8 lines in your changes missing coverage. Please review.

Project coverage is 63.75%. Comparing base (59551e4) to head (2bc84d6).
Report is 1602 commits behind head on master.

Files with missing lines Patch % Lines
...quota/HelixExternalViewBasedQueryQuotaManager.java 77.41% 5 Missing and 2 partials ⚠️
...esources/PinotApplicationQuotaRestletResource.java 0.00% 1 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##             master   #14859      +/-   ##
============================================
+ Coverage     61.75%   63.75%   +2.00%     
- Complexity      207     1612    +1405     
============================================
  Files          2436     2708     +272     
  Lines        133233   151326   +18093     
  Branches      20636    23362    +2726     
============================================
+ Hits          82274    96485   +14211     
- Misses        44911    47594    +2683     
- Partials       6048     7247    +1199     
Flag Coverage Δ
custom-integration1 100.00% <ø> (+99.99%) ⬆️
integration 100.00% <ø> (+99.99%) ⬆️
integration1 100.00% <ø> (+99.99%) ⬆️
integration2 0.00% <ø> (ø)
java-11 63.69% <75.00%> (+1.99%) ⬆️
java-21 63.65% <75.00%> (+2.02%) ⬆️
skip-bytebuffers-false 63.71% <75.00%> (+1.96%) ⬆️
skip-bytebuffers-true 63.63% <75.00%> (+35.90%) ⬆️
temurin 63.75% <75.00%> (+2.00%) ⬆️
unittests 63.75% <75.00%> (+2.00%) ⬆️
unittests1 56.27% <ø> (+9.38%) ⬆️
unittests2 34.07% <75.00%> (+6.34%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@siddharthteotia
Copy link
Contributor

siddharthteotia commented Jan 22, 2025

Do we have any existing tests that already exercise this path? Since we are changing the code on critical path, I suggest adding tests (if not there)

@@ -319,7 +319,7 @@ private void verifyQuotaUpdate(float quotaQps) {
} catch (IOException e) {
throw new RuntimeException(e);
}
}, 5000, "Failed to reflect query quota on rate limiter in 5s.");
}, 10000, "Failed to reflect query quota on rate limiter in 5s.");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this change expected?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This change is not strictly necessary, so I'll revert it.

@bziobrowski
Copy link
Contributor Author

Quotas are tested mainly in HelixExternalViewBasedQueryQuotaManagerTest and QueryQuotaClusterIntegrationTest. I'll have a look at line coverage today.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Query execution path is accessing metadata in zookeeper through Quota Managers
4 participants