Skip to content

Commit

Permalink
docs: add examples of Novita AI and DeepSeek llms (#603)
Browse files Browse the repository at this point in the history
Close #584 and #593.

The interfaces have been tested compatible with
`LLMProvider.OPENAI_LIKE`.
  • Loading branch information
jrj5423 authored Jan 20, 2025
1 parent 1e671f3 commit daf7e76
Showing 1 changed file with 29 additions and 0 deletions.
29 changes: 29 additions & 0 deletions frontend/app/src/pages/docs/llm.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -119,13 +119,16 @@ To learn more about vLLM, please visit [vLLM](https://docs.vllm.ai/en/stable/).

#### Xinference

If you assigned a model uid different from the model name, you need to fill in **model uid** in the box `model`.

Default config:

```json
{
"api_base": "http://localhost:9997/v1/"
}
```

To learn more about Xinference, please visit [Xinference](https://inference.readthedocs.io/en/latest/).


Expand Down Expand Up @@ -154,3 +157,29 @@ Do not mix `Model version` and `API version` up, they are different.

![Azure OpenAI Service Deployment Tab - LLM](https://github.com/user-attachments/assets/158f845c-5f38-40d7-b66a-8528d7df178e)

#### Novita AI

Default config:

```json
{
"api_base": "https://api.novita.ai/v3/openai"
}
```

To learn more about Novita AI, please visit [Novita AI](https://novita.ai/).

#### DeepSeek

DeepSeek provides chat model `deepseek-chat`.

Default config:

```json
{
"api_base": "https://api.deepseek.com/v1",
"is_chat_model": true
}
```

To learn more about DeepSeek, please visit [DeepSeek](https://www.deepseek.com/).

0 comments on commit daf7e76

Please sign in to comment.