Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for low-level interface in JSON schema #5

Open
Selfeer opened this issue Nov 4, 2024 · 1 comment
Open

Add support for low-level interface in JSON schema #5

Selfeer opened this issue Nov 4, 2024 · 1 comment
Assignees
Labels
feature features requests

Comments

@Selfeer
Copy link
Collaborator

Selfeer commented Nov 4, 2024

@Selfeer Selfeer added the feature features requests label Nov 4, 2024
@Selfeer
Copy link
Collaborator Author

Selfeer commented Nov 13, 2024

The current implementation for generating Parquet files utilizes the ExampleParquetWriter, which is a high-level implementation that offers many options but does not allow fine-tuning of everything.

parquet-java seems to be using a more low-level implementation in their tests, shown here: https://github.com/apache/parquet-java/blob/master/parquet-column/src/test/java/org/apache/parquet/column/impl/TestColumnReaderImpl.java#L55

We need to check if it's possible to use this low-level approach when generating Parquet files and implement it without removing the current implementation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature features requests
Projects
None yet
Development

No branches or pull requests

2 participants