Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

using deepseek problem #1305

Open
wuhq7 opened this issue Feb 15, 2025 · 1 comment
Open

using deepseek problem #1305

wuhq7 opened this issue Feb 15, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@wuhq7
Copy link

wuhq7 commented Feb 15, 2025

Referred to the example in this place(https://github.com/Canner/WrenAI/blob/main/wren-ai-service/docs/config_examples/config.deepseek.yaml), and modified the pipeline configuration of 0.15.3, please help to see where there is a problem that needs to be modified

config.txt

env.txt

wrenai-wren-ai-service-1.txt

@wuhq7 wuhq7 added the bug Something isn't working label Feb 15, 2025
@jos666
Copy link

jos666 commented Feb 24, 2025

  1. embedder 配置要修改 deepseek 没有embedder 模型(本地部署 nomic-embed-text 模型)
#运行ollama server
OLLAMA_HOST="0.0.0.0" #设置这个环境变量
ollama pull nomic-embed-text
ollama serve
type: embedder
provider: litellm_embedder
models:
- model: openai/nomic-embed-text  # put your embedding model name here, if it is not openai embedding model, should be <provider>/<model_name>
  api_base: http://192.168.1.88:11434/v1  # change this according to your embedding model    
  #api_key_name: EMBEDDER_OLLAMA_API_KEY
  api_key_name: OPENAI_API_KEY
  timeout: 600
  1. type: document_store 的 embedding_model_dim 修改为 768
  2. deepseek 官方的api限流经常503体验不好

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants