Skip to content

Latest commit

 

History

History
19 lines (10 loc) · 1015 Bytes

ollama.md

File metadata and controls

19 lines (10 loc) · 1015 Bytes
Raw

Ollama

See the Ollama documentation on how to set up a self-hosted Ollama API endpoint (e.g. using ollama serve).

Environment variables:

  • OLLAMA_API_ENDPOINT: the endpoint for the Ollama API

Model-specific environment variables:

As described in the model-specific environment variables of the environment variables document section, you can set model-specific environment variables for different models in Ollama by appending the model name to the environment variable name. For example, if "model_name": "prompto_model" is specified in the prompt_dict, the following model-specific environment variables can be used:

  • OLLAMA_API_ENDPOINT_prompto_model

Required environment variables:

For any given prompt_dict, the following environment variables are required:

  • One of OLLAMA_API_ENDPOINT or OLLAMA_API_ENDPOINT_model_name