-
Notifications
You must be signed in to change notification settings - Fork 144
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support for generator. #166
Comments
Add
|
Could you explain how this gonna work in detail will it use chunking to load only a few record into application memory? |
I have quite the same issue @Legion112 , did you find a clean solution ? I seems the right way is to use a streamReader but I can't find a simple way to process each record properly without going into complex stream buffering stuff. Would there be a simple way to achieve that @isublimity ? Thanks ! |
Hm.. I haven't finished that feature in my application. (We cancel the creation of features which require this API) |
Thanks for your feedback @Legion112 :) Here's a quick class I've written to make the job easier (we use JSON format, so your QUERY must have FORMAT JSONEachRow):
|
Instead of loading all item in mermory
->rows
or using thereadSteam
function would be nice to have a iterator interface to be able to loop all items without loading them to memory.Something like:
The text was updated successfully, but these errors were encountered: