Skip to content
This repository has been archived by the owner on Nov 1, 2024. It is now read-only.

Support apache-datafusion #420

Open
waitingkuo opened this issue Jul 1, 2022 · 0 comments
Open

Support apache-datafusion #420

waitingkuo opened this issue Jul 1, 2022 · 0 comments

Comments

@waitingkuo
Copy link
Contributor

Datafusion https://github.com/apache/arrow-datafusion is the subproject of apache arrow

I can do ta.from_arrow(pa.Table.from_batches( datafusion_dataframe.collect()) for now to

  1. convert datafusion's dataframe to arrow batch record
  2. convert arrow batch record to pyarrow table
  3. use ta.from_arrow to load it

wonder whether this is interesting for you to support datafusion's dataframe directly via

ta.from_datafusion( datafusion_dataframe )
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant