Skip to content

[config] Change default value of max_bucket_num_per_partition to 768#62286

Merged
gavinchou merged 1 commit intoapache:masterfrom
gavinchou:gavin-max_bucket_num_per_partition
Apr 10, 2026
Merged

[config] Change default value of max_bucket_num_per_partition to 768#62286
gavinchou merged 1 commit intoapache:masterfrom
gavinchou:gavin-max_bucket_num_per_partition

Conversation

@gavinchou
Copy link
Copy Markdown
Contributor

@gavinchou gavinchou commented Apr 9, 2026

follow up #61576

Summary

Increase the default value of max_bucket_num_per_partition from 128 to 768 to support larger partition bucket configurations by the benchmarks

Changes

  • Modified Config.java to change the default value of max_bucket_num_per_partition from autobucket_max_buckets (128) to 768

Testing

  • FE unit tests passed locally

Increase the default maximum number of buckets per partition from 128 to 768
to support larger partition bucket configurations.
@hello-stephen
Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@gavinchou
Copy link
Copy Markdown
Contributor Author

run buildall

@github-actions
Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 10, 2026
@github-actions
Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@gavinchou gavinchou merged commit 5d64780 into apache:master Apr 10, 2026
30 of 35 checks passed
gavinchou pushed a commit to gavinchou/doris that referenced this pull request Apr 10, 2026
…t number

Add a new FE config `max_bucket_num_per_partition` to limit the maximum number
of buckets when creating a table or adding a partition. Default value is 768.

Changes:
1. Add `max_bucket_num_per_partition` config in Config.java, defaulting to 768
2. Add bucket number validation in `DistributionDescriptor.validate()` for CREATE TABLE scenario
3. Add bucket number validation in `InternalCatalog.addPartition()` for ALTER TABLE ADD PARTITION scenario
4. Add unit tests for the new validation logic
5. Add regression test configurations

Behavior:
- For user-specified buckets (CREATE TABLE / ALTER TABLE ADD PARTITION): if bucket
  number exceeds this limit, the operation will be rejected with a helpful error message
- For auto-bucket feature (Dynamic Partition): bucket number is capped by
  `autobucket_max_buckets` automatically, no change
- Set to 0 or negative value to disable this limit

Cherry-picked from PR apache#61576 and apache#62286
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/4.1.x dev/4.1.x-conflict reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants