need suggestion on database and tool sets of MLOPTs #1554
enthusiastics
started this conversation in
General
Replies: 1 comment
-
Hello @enthusiastics , Disclaimer: author of oups and contributor to fastparquet here, but not a great packager, and only coding in spare time :) As you request suggestion, I would suggest oups. It might not be the ideal answer, and I have not battle-proved it yet for this purpose, but I have such application in mind when implementing it.
All this to say if in terms of speed, it does not match your need, there might be yet some potential, but not for the short term. My next move is to integrate it as backbone in my own data processing framework (based on numpy, pandas, vaex...) now that I have reached the MPV in terms of features. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi,
I just found Vaex and I think this is an extremely valuable technology, especially for my use case where we require very fast and scalable computation. I actually want to put Vaex into production. But I would like to ask what is the most compatible streaming data tools and database to use (basically, I would need to stream data, apply realtime transformation, output real time prediction, and also store results into database for future reference (or future restarts.))? I really want to apply Vaex to tick data where there is massive volume and per second and high speed analysis is needed.
Beta Was this translation helpful? Give feedback.
All reactions