Skip to content

Conversation

@JaredforReal
Copy link
Collaborator

@JaredforReal JaredforReal commented Oct 13, 2025

What this PR does / why we need it:

  • update how we use kind to leverage hostPath PVC for models
  • add dashboard/, openwebui/, pipelines/, chat-ui, mongo to deploy/kubernetes/observability/
  • update deploy/docker-compose/README.md
  • update deploy/kubernetes/README.md
  • update deploy/kubernetes/observability/README.md
image

@netlify
Copy link

netlify bot commented Oct 13, 2025

Deploy Preview for vllm-semantic-router ready!

Name Link
🔨 Latest commit 9c104f3
🔍 Latest deploy log https://app.netlify.com/projects/vllm-semantic-router/deploys/68fa696e1ae98f000899022a
😎 Deploy Preview https://deploy-preview-411--vllm-semantic-router.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@github-actions
Copy link

github-actions bot commented Oct 13, 2025

👥 vLLM Semantic Team Notification

The following members have been identified for the changed files in this PR and have been automatically assigned:

📁 Root Directory

Owners: @rootfs, @Xunzhuo
Files changed:

  • .github/workflows/k8s-config-test.yml
  • .github/workflows/k8s-kind-integration-test.yml
  • .github/workflows/k8s-security-scan.yml
  • .github/workflows/k8s-shared-config.yml
  • .github/workflows/k8s-validate-manifests.yml
  • .github/workflows/k8s-integration-test.yml
  • .gitignore

📁 deploy

Owners: @rootfs, @Xunzhuo
Files changed:

  • deploy/kubernetes/observability/chat-ui/deployment.yaml
  • deploy/kubernetes/observability/dashboard/config.yaml
  • deploy/kubernetes/observability/dashboard/configmap.yaml
  • deploy/kubernetes/observability/dashboard/deployment.yaml
  • deploy/kubernetes/observability/dashboard/service.yaml
  • deploy/kubernetes/observability/dashboard/tools_db.json
  • deploy/kubernetes/observability/mongo/deployment.yaml
  • deploy/kubernetes/observability/openwebui/deployment.yaml
  • deploy/kubernetes/observability/pipelines/deployment.yaml
  • deploy/kubernetes/observability/pipelines/vllm_semantic_router_pipe.py
  • deploy/kubernetes/pv-models.yaml
  • deploy/docker-compose/README.md
  • deploy/kubernetes/README.md
  • deploy/kubernetes/config.yaml
  • deploy/kubernetes/deployment.yaml
  • deploy/kubernetes/kustomization.yaml
  • deploy/kubernetes/observability/README.md
  • deploy/kubernetes/observability/ingress.yaml
  • deploy/kubernetes/observability/kustomization.yaml

📁 tools

Owners: @yuluo-yx, @rootfs, @Xunzhuo
Files changed:

  • tools/kind/README.md
  • tools/kind/generate-kind-config.sh
  • tools/kind/kind-config.yaml.template

vLLM

🎉 Thanks for your contributions!

This comment was automatically generated based on the OWNER files in the repository.

@JaredforReal
Copy link
Collaborator Author

need more test, leave it as draft

@JaredforReal
Copy link
Collaborator Author

What will do in follow-up PRs: some docs to be updated; fix internal network error; add llm-katan; introduce ways to mount local models files

@JaredforReal
Copy link
Collaborator Author

JaredforReal commented Oct 23, 2025

Sorry it took a bit and is rough for now — it should be ready for review now. I’ll keep polishing it along the way. @rootfs @Xunzhuo

@JaredforReal JaredforReal marked this pull request as ready for review October 23, 2025 08:20
@rootfs
Copy link
Collaborator

rootfs commented Oct 23, 2025

@JaredforReal why some tests failed but no error message?

Signed-off-by: JaredforReal <[email protected]>
Signed-off-by: JaredforReal <[email protected]>
Signed-off-by: JaredforReal <[email protected]>
Signed-off-by: JaredforReal <[email protected]>
Signed-off-by: JaredforReal <[email protected]>
Signed-off-by: JaredforReal <[email protected]>
Signed-off-by: JaredforReal <[email protected]>
Signed-off-by: JaredforReal <[email protected]>
Signed-off-by: JaredforReal <[email protected]>
Signed-off-by: JaredforReal <[email protected]>
Signed-off-by: JaredforReal <[email protected]>
Signed-off-by: JaredforReal <[email protected]>
@rootfs rootfs merged commit b351a5c into vllm-project:main Oct 23, 2025
15 checks passed
@rootfs
Copy link
Collaborator

rootfs commented Oct 23, 2025

thank you! this is great!

@JaredforReal JaredforReal deleted the k8s branch October 24, 2025 06:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants