Skip to content
This repository has been archived by the owner on Feb 17, 2023. It is now read-only.

Releases: uccross/skyhookdm-arrow

v0.4.1

21 Apr 21:35
Compare
Choose a tag to compare

Minor release with error handling patches

v0.4.0

21 Dec 19:26
6895138
Compare
Choose a tag to compare
SKYHOOK-273: [CI] Add benchmark trigger workflow

v0.3.0

27 Jul 17:39
Compare
Choose a tag to compare

What's new in this release 🎉

  • 039b1d7, 9e9d6dd : Rename RadosParquetFileFormat to SkyhookFileFormat to abstract over different real file formats like CSV, IPC, JSON, Parquet.

  • 07b2f20: Add support for RadosParquet to JNI Dataset API bindings and update SkyhookDM deployment scripts to install JARs for the JNI Dataset API.

  • 2e8598f - Add a thread-safe connection abstraction for RadosParquet along with other minor improvements to the APIs.

  • 64181c0: Rebase SkyhookDM to latest Apache Arrow 5.0.0 release.

  • 683fe48: Set osd_class_dir to make the CLS library lookup path portable across environments.

  • 79e3073, a8dd52b, 8805a21, f0285ef, dfd0c79 - Add docstrings to all the new source files added for SkyhookDM.

  • 6dc047e - Add Netlify based CD workflow for automatically deploying documentation on every push.

  • b111e7a, e2a5e2a - Add a benchmarking guide for beginners to get started with SkyhookDM benchmarking.

  • b08fe9e, 93c008c : Made Ceph and Skyhook deploy scripts more dynamic and fault tolerant.

Thanks a lot to @YashJipkate , @ljishen , and @Sebastiaan-Alvarez-Rodriguez for their valuable contributions in this release.

v0.2.1-rc1

19 Jul 07:40
Compare
Choose a tag to compare
SKYHOOK-207: [Java] Add optional Java and JNI builds to deploy_skyhoo…

…k.sh script

v0.2.0

30 May 12:22
Compare
Choose a tag to compare

Changes in v0.2.0

  1. c0f278b: Upgrade SkyhookDM to Apache Arrow 4.x.
  2. Send back results in much more faster Lz4 compressed IPC format.
  3. 25bc170: Flatbuffers to serialize Scan Request.
  4. Move skyhook-ci workflow to uccross/skyhookdm-arrow-docker
  5. 8636266: Fix memory leaks on both the client and CLS sides.
  6. 39a535c: Modify SplittedParquetWriter to be able to split Parquet files by estimating row group sizes based on compression ratio.
  7. Update documentation with architecture document and add utility scripts.

v0.1.1

13 Mar 08:06
Compare
Choose a tag to compare

Changes in this release

#95: Improvements to the SplittedParquetWriter and bug fixes in the Skyhook-CI pipeline
#101: Misc. improvements on the client-side
#105: Fix bug causing unwanted client-side filtering when using RadosParquetFileFormat
#107: Remove costly table print code from CLS

v0.1.0 - First Release !

15 Feb 17:33
Compare
Choose a tag to compare

Please follow this README for a quick start guide and instructions for installation and setting up the development environment.

Thanks to @jlefevre, @ivotron, @esmaeil-mirvakili, and @kingwind123 for their invaluable contributions.