Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: Compatibility with LM Studio folders #5

Open
ruze00 opened this issue Jan 20, 2025 · 2 comments
Open

Feature Request: Compatibility with LM Studio folders #5

ruze00 opened this issue Jan 20, 2025 · 2 comments

Comments

@ruze00
Copy link

ruze00 commented Jan 20, 2025

Just like using HuggingFace download folders, can you also extend it to use LM Studio download folders if installed? That would provide the best of both (three?) worlds! Use case: I have both GGUF and MLX files downloaded by LM Studio and want to share their use via Ollama-like interface.

@kspviswa
Copy link
Owner

Sure. Could you provide more info on the standard paths?

@ruze00
Copy link
Author

ruze00 commented Jan 27, 2025

The folder convention is:

.cache/lm-studio/{provider}/{model-name}/{files}

eg.
.cache/lm-studio/models/mlx-community/nvidia_Llama-3.1-Nemotron-70B-Instruct-HF_4bit/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants