Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Petastorm break with pyarrow 13.0 or newer. Stable version of pyarrow is at 16.0 now. #805

Open
LauritsDixen opened this issue May 1, 2024 · 1 comment
Open

Petastorm break with pyarrow 13.0 or newer. Stable version of pyarrow is at 16.0 now. #805

LauritsDixen opened this issue May 1, 2024 · 1 comment

Comments

@LauritsDixen
Copy link

Several parts of pyarrow has changed and deprecated.

Running with 12.0 gives FutureWarnings of using objects that has deprecated since 5.0.0!

Here is such a warning.
/python3.11/site-packages/petastorm/etl/dataset_metadata.py:288: FutureWarning: ParquetDatasetPiece is deprecated as of pyarrow 5.0.0 and will be removed in a future version

Are there any plans of updating?
@selitvin
Copy link
Collaborator

selitvin commented May 3, 2024

I do not actively maintain the project. Would be happy to review a PR if you can put it up.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@selitvin @LauritsDixen