Should we have a ollama dev services? #42060
emmanuelbernard
started this conversation in
Design Discussions
Replies: 1 comment 8 replies
-
We tried something like that and it was not a good experience. What we have settled on (fairly recently) is that all you have to do as a developer is have Ollama installed and Quarkus takes care of installing the configured model |
Beta Was this translation helpful? Give feedback.
8 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
When starting with ollama from a quarkus app, I ended up with "cannot connect to ...". So I figured it out and installed ollama on my machine. Then I realized my ollama did not have downloaded the models I wanted and I did a
ollama pull
.A devservices and a way to read the config could make that transparent for the developer.
Here are possible cons though:
~/.ollama
CC @geoand @dandreadis
Beta Was this translation helpful? Give feedback.
All reactions