Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Available as tflite? #79

Open
charlieforward9 opened this issue Dec 19, 2024 · 1 comment
Open

Available as tflite? #79

charlieforward9 opened this issue Dec 19, 2024 · 1 comment

Comments

@charlieforward9
Copy link

charlieforward9 commented Dec 19, 2024

I would like to run this within my Flutter app as a tflite file. Is that possible? What are some other options?

EDIT: looks like this is what is required: https://ai.google.dev/edge/litert/models/pytorch_to_tflite

@charlieforward9
Copy link
Author

charlieforward9 commented Dec 20, 2024

EDIT: looks like this is what is required: https://ai.google.dev/edge/litert/models/pytorch_to_tflite

I encounted a few challenges with package versions and availability of packages outside of my understanding whe trying to get this workig

Ultimately got stuck on a problem with pip install torch_xla not working for me on my Mac. I tried running the conversion script on this Google Collab runtime and encountered memory limit issues using up to 51GB.

To work around my lack of understanding in the short term, I used the tflite file from this Midas project with relatively quick inference (1/seconds), I also tested with the DepthAnything model in my app, but this one inferred pretty slow (1/5-10seconds)...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant