We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 3cfb835 commit 935c134Copy full SHA for 935c134
docker-compose.yaml
@@ -44,6 +44,7 @@ x-vllm: &vllm_template
44
command: >
45
--model ${EMBEDDER_MODEL_NAME:-jinaai/jina-embeddings-v3}
46
--trust-remote-code
47
+ --gpu_memory_utilization 0.3
48
ports:
49
- ${VLLM_PORT:-8000}:8000
50
0 commit comments