馃搵 Prerequisites
馃幆 Affected Service(s)
Multiple services / System-wide issue
馃殾 Impact/Severity
Minor inconvenience
馃悰 Bug Description
I am running a self-hosted model using vLLM which exposes an OpenAI API compatible endpoint. Creating a ModelConfig after installation works to onboard this model endpoint to kagent but the problem is that during initial installation using the helm chart, the baseUrl for the OpenAI provider is ignored. This makes it not possible to use the default model unless the default ModelConfig is manually updated to add baseUrl after kagent installation.
馃攧 Steps To Reproduce
- Deploy a self-hosted model with openai api
- Use helm values.yaml similar to below, specifying
baseUrl
- Observe that the default model config does not use the specified
baseUrl by querying the resulting default-model-config. Also observe that default auto-created agents result in 401 error when querying
- Manually add
baseUrl to default-model-config and observe agents now work correctly
providers:
default: openAI
openAI:
provider: OpenAI
model: "deepseek-ai/DeepSeek-V4-Flash-0731"
apiKeySecretRef: kagent-my-provider
apiKeySecretKey: PROVIDER_API_KEY
openAI:
baseUrl: "https://base_url.tld/v1"
tls:
caCertSecretRef: llm-certs
caCertSecretKey: ca.crt
controller:
substrate:
enabled: true
ateApiEndpoint: dns:///api.ate-system.svc:443
ateApiInsecure: true
substrateWorkerPool:
create: true
replicas: 1
ateomImage: ghcr.io/kagent-dev/substrate/ateom-gvisor:v0.0.6
馃 Expected Behavior
The default-model-config contains the specified baseUrl and default auto-created agents work successfully
馃摫 Actual Behavior
The default-model-config does not contain the specified baseUrl and default auto-created agents fail with 401 error when querying
馃捇 Environment
- MacOS
- Kind cluster with k8s v1.34.0
- Helm chart version 0.9.9
馃敡 CLI Bug Report
No response
馃攳 Additional Context
Manually modifying default-model-config with the baseUrl fixes it but we should be able to specify this at install time
馃搵 Logs
馃摲 Screenshots
No response
馃檵 Are you willing to contribute?
馃搵 Prerequisites
馃幆 Affected Service(s)
Multiple services / System-wide issue
馃殾 Impact/Severity
Minor inconvenience
馃悰 Bug Description
I am running a self-hosted model using vLLM which exposes an OpenAI API compatible endpoint. Creating a
ModelConfigafter installation works to onboard this model endpoint to kagent but the problem is that during initial installation using the helm chart, thebaseUrlfor the OpenAI provider is ignored. This makes it not possible to use the default model unless the defaultModelConfigis manually updated to addbaseUrlafter kagent installation.馃攧 Steps To Reproduce
baseUrlbaseUrlby querying the resultingdefault-model-config. Also observe that default auto-created agents result in 401 error when queryingbaseUrltodefault-model-configand observe agents now work correctly馃 Expected Behavior
The
default-model-configcontains the specifiedbaseUrland default auto-created agents work successfully馃摫 Actual Behavior
The
default-model-configdoes not contain the specifiedbaseUrland default auto-created agents fail with 401 error when querying馃捇 Environment
馃敡 CLI Bug Report
No response
馃攳 Additional Context
Manually modifying
default-model-configwith thebaseUrlfixes it but we should be able to specify this at install time馃搵 Logs
馃摲 Screenshots
No response
馃檵 Are you willing to contribute?