Skip to content

Add Apache Arrow Go Parquet writer and reader - #26

Merged
mprammer merged 5 commits into
developfrom
mp/arrow-go
Oct 13, 2026
Merged

mprammer merged 5 commits into
developfrom
mp/arrow-go

Conversation

@mprammer

Copy link
Copy Markdown
Contributor

Add parquet@go using Apache Arrow Go 18.8.0 so datasets can be written and checked with another Parquet implementation, as tracked in #6. The sidecar reads canonical Arrow IPC, applies the shared writer settings, and verifies its output before publication.

Page indexes default on with statistics. Unsupported checksum and exact page-row requests are refused. Row-group boundaries use an uncompressed planning encoder so changing compression does not change the sizing target.

🤖 Generated with Codex

Signed-off-by: Martin Prammer <martin@spiraldb.com>
Signed-off-by: Martin Prammer <martin@spiraldb.com>
Signed-off-by: Martin Prammer <martin@spiraldb.com>
Signed-off-by: Martin Prammer <martin@spiraldb.com>
Signed-off-by: Martin Prammer <martin@spiraldb.com>
@mprammer
mprammer marked this pull request as ready for review October 13, 2026 01:20
@mprammer
mprammer merged commit f8daddb into develop Oct 13, 2026
17 checks passed
@mprammer
mprammer deleted the mp/arrow-go branch October 13, 2026 01:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant