Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to pass the secret for model-registry csi in kserve #745

Open
Yokesh-RS opened this issue Feb 2, 2025 · 0 comments
Open

How to pass the secret for model-registry csi in kserve #745

Yokesh-RS opened this issue Feb 2, 2025 · 0 comments

Comments

@Yokesh-RS
Copy link

if the registered model has s3:///modelname

I passed model-registry:///.

I have made a secret and service account to pass in the creds , however I end up in this error

kubectl logs -n model-workloads gpt-2-modelregistry-predictor-00001-deployment-568cc645d4-zljks -c storage-initializer
Initializing, args: src_uri [model-registry://gpt-model/1] dest_path[ [/mnt/models]
Falling back to base url model-registry-service.kubeflow.svc.cluster.local:8080 for model registry service
Download model indexed in model registry: modelName=, storageUri=model-registry://gpt-model/1, modelDir=/mnt/models
Parsed storageUri=model-registry://gpt-model/1 as: modelRegistryUrl=model-registry-service.kubeflow.svc.cluster.local:8080, registeredModelName=gpt-model, versionName=0xc0008142b0
Fetching model: registeredModelName=gpt-model, versionName=0xc0008142b0
Fetching model version: model=&{0xc0008100c8 0xc0008123a0 gpt-model 0xc0008123b0 0xc000812390 0xc0008123c0 0xc0008123d0 0xc0008123e0}
Fetching model artifacts: version=&{0xc00088c070 0xc000812200 1 0xc000812230 0xc00088e1d0 3 0xc000812210 0xc00088e1e0 0xc000812220}
Error downloading the model: unable to get batch objects RequestError: send request failed
caused by: Get "http://modelserving.10.10.10.10:12345/?prefix=gpt2": dial tcp: lookup modelserving.10.10.10.10 on 19.25.25.10:53: no such host

the s3 uri is s3://modelserving/gpt2

the modelregistry uri is : model-registry://gpt-model/1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant