-
Notifications
You must be signed in to change notification settings - Fork 248
Fix: Fix null handling in CometVector implementations #2643
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Codecov Report❌ Patch coverage is Additional details and impacted files@@ Coverage Diff @@
## main #2643 +/- ##
============================================
+ Coverage 56.12% 59.25% +3.12%
- Complexity 976 1449 +473
============================================
Files 119 147 +28
Lines 11743 13761 +2018
Branches 2251 2367 +116
============================================
+ Hits 6591 8154 +1563
- Misses 4012 4383 +371
- Partials 1140 1224 +84 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
CometPlainVector#getBinary
|
|
Yes, I completely agree that unnecessary null checking should be avoided for performance reasons.
For |
|
The failing unit tests appear to be related to the |
I stand corrected. This does make the implementations consistent with Spark. |
| // | ||
| // This code is also based on the implementation of the array_insert from the Apache Spark | ||
| // https://github.com/apache/spark/blob/branch-3.5/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala#L4713 | ||
| // Implementation aligned with Arrow's half-open offset ranges and Spark semantics. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The version fixed by ChatGPT :)
CometPlainVector#getBinary
Which issue does this PR close?
Closes #2612.
Rationale for this change
What changes are included in this PR?
How are these changes tested?
Added UT.