New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reduce daemon memory usage #68

Open

SeanPedersen opened this issue Feb 2, 2021 · 0 comments

Projects

Member

SeanPedersen commented Feb 2, 2021 •

edited

Loading

The daemon needs around 2GB of RAM and 1GB of VRAM right now. Try to minimize this.

Possible strategies:

Distill CLIP model
Replace DistilBERT with CLIP's text encoder (see Evaluate CLIP performance on text to text similarity #41 though...)

SeanPedersen added this to Low Priority in TODO

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment