Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

implement a custom save function for R6 objects to avoid slow serialisation. #81

Open
asiripanich opened this issue May 28, 2020 · 0 comments
Open

implement a custom save function for R6 objects to avoid slow serialisation. #81

asiripanich opened this issue May 28, 2020 · 0 comments
Labels
feature New feature or request performance

Comments

@asiripanich
Copy link
Member

asiripanich commented May 28, 2020 •
edited
Loading

save R6 objects as RDS can take very long time to load.

Ideas:
Save all data objects individually. Ideally, we want to avoid *.rds for large objects. Maybe giving the user choices of backends (fst, feather, qs) would be good.

Things to beware of:

  • A world object has fields that point to other objects in the memory hence this will be quite hard to rebuild all linked objects correctly.
@asiripanich asiripanich changed the title implement a custom save function for R6 objects to avoid saving serialising them. implement a custom save function for R6 objects to avoid serialisation. May 28, 2020
@asiripanich asiripanich changed the title implement a custom save function for R6 objects to avoid serialisation. implement a custom save function for R6 objects to avoid slow serialisation. May 29, 2020
@asiripanich asiripanich added feature New feature or request performance labels Jun 17, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature New feature or request performance
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@asiripanich