Skip to content
This repository has been archived by the owner on Jun 14, 2024. It is now read-only.

Hyperspace v0.2.0

Pre-release
Pre-release
Compare
Choose a tag to compare
@imback82 imback82 released this 05 Aug 21:56

We are excited to announce the release of Hyperspace 0.2.0!

Notable new features / improvements:

  • Python APIs (#36): You can now manage/utilize Hyperspace indexes using Python APIs. Please checkout the user guide to get started.
  • Support case-insensitive index column names (#78): The case sensitivity config in Spark (spark.sql.caseSensitive) is now respected when index column names are matched to find candidate indexes.
  • New signature provider(#77): The signature provider has been updated to compute the signature of an arbitrary logical plan (in addition to the existing file-based signature) to be more flexible (e.g, an upcoming feature where you can create an index on any dataframes)
  • FilterIndex rule improvement(#73): FilterIndex rule has been updated to match a logical plan where Project node is not present (e.g, SELECT * scenario).

Breaking changes:

In order to better support compatibility across Scala/Spark versions going forward, the team has decided to stop serializing logical plans with KyroSerializer and store the minimum info to reconstruct the original relation(#99). Thus, the indexes generated with v0.1.0 are not compatible with v0.2.0 and need to be reconstructed.

Thank you for trying it out and we look forward to your feedback!

Credits
Andrew Fogarty, Apoorve Dave, Eunjin Song, Justin Breese, Pouria Pirzadeh, Rahul Potharaju, Tarun Rajput, Terry Kim, Veysi Ertekin, Yash Datta