-
Notifications
You must be signed in to change notification settings - Fork 239
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[DOC] update doc for 24.12 release [skip ci] #11841
Conversation
Signed-off-by: liyuan <[email protected]>
Signed-off-by: liyuan <[email protected]>
docs/download.md
Outdated
* Support ArrayJoin expression | ||
* Optimize Expand and Aggregate expression performance | ||
* Improve JSON related expressions | ||
* Implement Kudo shuffle format to improve shuffle performance |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This disabled by default with an internal config. There's no documentation on how to enable this, so I'm not sure it's appropriate to call it out here. It also doesn't improve shuffle performance for small schemas and/or relatively small partition counts (e.g.: default 200 or less).
docs/download.md
Outdated
* Optimize Expand and Aggregate expression performance | ||
* Improve JSON related expressions | ||
* Implement Kudo shuffle format to improve shuffle performance | ||
* Add the ability to decompress snappy and ztsd compressed Parquet files via CPU |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is also an internal-only config with no documentation. Not sure this is appropriate to advertise.
docs/download.md
Outdated
* Implement Kudo shuffle format to improve shuffle performance | ||
* Add the ability to decompress snappy and ztsd compressed Parquet files via CPU | ||
* Add repartition-based algorithm fallback in hash aggregate | ||
* Support spark function months_between |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
* Support spark function months_between | |
* Support Spark function months_between |
docs/download.md
Outdated
* Support asynchronous writing for Parquet files | ||
* Add retry support to improve sub hash-join stability | ||
* Improve JSON scan and from_json | ||
* Support setting a limited number of tasks for build-in profiling tool |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Same issue here, the self-profiling tool is still experimental and not publicly documented yet.
docs/download.md
Outdated
* Add retry support to improve sub hash-join stability | ||
* Improve JSON scan and from_json | ||
* Support setting a limited number of tasks for build-in profiling tool | ||
* Bugs fix for memory leak |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ideally this should be a bit more descriptive. Is it a host or device memory leak? What are the conditions for the leak, i.e.: what types of operations were affected?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Double check the PRs that we don't have a memory leak bug fix this release, will remove it.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We have at least this one: 3449c8a
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
and this one 96a58d1
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
updated, thx
Signed-off-by: liyuan <[email protected]>
Just double checking that this PR can go in after #11848. Or, should it be pulled into the merge to main branch? Probably doesn't matter too much. |
Signed-off-by: liyuan <[email protected]>
Yes, we'll do the final up-merge for merge-to-main PR #11848, to include all PRs targeting to the branch-24.12, then merge them to main! |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Signed-off-by: liyuan <[email protected]>
build |
This PR updates download docs for 24.12.0 release.
Signed-off-by: liyuan [email protected]