ArrowInvalid('Unsupported Type:large_list<item: large_string>') #2322

Unanswered

omprakash-bungee asked this question in Q&A

omprakash-bungee
Jan 5, 2023

While trying to convert the Vaex data frame to CSV, getting an ArrowInvalid('Unsupported Type:large_list<item: large_string>') error.

using export_csv() method.
dataframe.export_csv(path=filePath, chunk_size=chunkSize, parallel=True, backend='arrow')
One of the data frame columns has datatype as large_list<item: large_string>.

What is the best to tackle this error?
Does Vaex has any inbuilt solution for this?

FYI: I have tried dataframe.export_csv(path=filePath, chunk_size=chunkSize, parallel=True, backend='pandas') its working fine.

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment