Skip to content

Conversation

@przepeck
Copy link
Collaborator

🛠 Summary

CVS-175208
Adding windows commands for demo, using OV models instead of external, changes in agentic usecase.
[Preview]https://openvino-doc.iotg.sclab.intel.com/preview/model-server/ovms_demos_integration_with_open_webui.html

🧪 Checklist

  • Unit tests added.
  • The documentation updated.
  • Change follows security best practices.
    ``

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR updates the OpenWebUI integration demo to add Windows support, replace external models with pre-converted OpenVINO models, and update the agentic use case. The changes streamline the setup process by using the --pull parameter to download models directly instead of requiring manual export steps, and provide platform-specific instructions for both Windows and Linux environments.

Key changes:

  • Added Windows-specific command examples alongside Linux/Docker commands using tab-set formatting
  • Replaced external models (meta-llama, sentence-transformers, BAAI, dreamlike-art, OpenGVLab) with pre-converted OpenVINO models (Godreign, OpenVINO org models)
  • Updated agentic use case from time server to weather server using MCP tools

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants