Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Installation using helm following readme is giving errors #43

Open
kodefoundry opened this issue Mar 14, 2024 · 4 comments
Open

Installation using helm following readme is giving errors #43

kodefoundry opened this issue Mar 14, 2024 · 4 comments

Comments

@kodefoundry
Copy link

I am trying to deploy local-ai using helm charts as mentioned in the Readme.md on a rke2 cluster running kubernetes 1.27 version

Initially I faced this error

helm install local-ai go-skynet/local-ai -f values.yaml
coalesce.go:286: warning: cannot overwrite table with non table for local-ai.deployment.image (map[repository:quay.io/go-skynet/local-ai tag:latest])
Error: INSTALLATION FAILED: template: local-ai/templates/deployment.yaml:234:28: executing "local-ai/templates/deployment.yaml" at <.Values.deployment.image.repository>: can't evaluate field repository in type interface {}

I changed the below in values.yaml provided in Readme.md and looks like installation moved on from this error
Changed

deployment:
  image:
    repository: quay.io/go-skynet/local-ai
    tag: latest

Original

deployment:
  image: quay.io/go-skynet/local-ai:latest

then I deleted the charts and ensured there is nothing leftover from previous failed installation before attempting installation again using the same helm install as above. Now I am seeing a new error that I am kind of clueless

helm install local-ai go-skynet/local-ai -f values1.yaml
Error: INSTALLATION FAILED: 2 errors occurred:
        * PersistentVolumeClaim "local-ai-models" is invalid: spec.storageClassName: Invalid value: "hostPath": a lowercase RFC 1123 subdomain must consist of lower case alphanumeric characters, '-' or '.', and must start and end with an alphanumeric character (e.g. 'example.com', regex used for validation is '[a-z0-9]([-a-z0-9]*[a-z0-9])?(\.[a-z0-9]([-a-z0-9]*[a-z0-9])?)*')
        * PersistentVolumeClaim "local-ai-output" is invalid: spec.storageClassName: Invalid value: "hostPath": a lowercase RFC 1123 subdomain must consist of lower case alphanumeric characters, '-' or '.', and must start and end with an alphanumeric character (e.g. 'example.com', regex used for validation is '[a-z0-9]([-a-z0-9]*[a-z0-9])?(\.[a-z0-9]([-a-z0-9]*[a-z0-9])?)*')
@6yteforge
Copy link

I was able to deploy using this chart successfully after making the below changes in the values.yaml file from the example values.yaml shared in Readme.md file here

changed lno 43 & 50
storageClass: hostPath -> storageClass: host-path

I have tried this in Kubernetes version 1.27.

@6yteforge
Copy link

I think this issue can be closed if we can update the Readme.md as described above.
The only risk I see is older k8s versions where this might have worked.

@qingfenghcy
Copy link

Hello, did you successfully deploy the gpu version of localai on the k8s cluster? I can run the cpu version normally, but I am having some problems using the gpu image.(mudler/LocalAI#1798)

@kodefoundry
Copy link
Author

kodefoundry commented Mar 21, 2024

I have not specifically tried anything different other than following the readme.md. I assume that one is a CPU version. Which I was able to deploy after I did the above changes.
I can give the GPU version a try, if you let me know which specific image to be used. Alternatively if you can share the steps you tried I can give it a try.
PS- 6yteforge is me only :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants