Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"404 Resource Not Found" when using Azure OpenAI model endpoint #1309

Open
gqoew opened this issue Jun 26, 2024 · 2 comments
Open

"404 Resource Not Found" when using Azure OpenAI model endpoint #1309

gqoew opened this issue Jun 26, 2024 · 2 comments
Labels
support A request for help setting things up

Comments

@gqoew
Copy link

gqoew commented Jun 26, 2024

I run chat-ui with the chat-ui-db docker image. I would like to connect it to my Azure OpenAI API endpoint.
I have setup the env.local file as stated in your docs and binded it with the docker container:

MODELS=`[{
  "id": "gpt-4-1106-preview",
  "name": "gpt-4-1106-preview",
  "displayName": "gpt-4-1106-preview",
  "parameters": {
      "temperature": 0.5,
      "max_new_tokens": 4096,
  },
  "endpoints": [
      {
          "type": "openai",
          "baseURL": "https://{resource-name}.openai.azure.com/openai/deployments/{deployment-id}/chat/completions",
          "defaultHeaders": {
              "api-key": "{api-key}"
          },
          "defaultQuery": {
              "api-version": "{api-version}"
          }
      }
  ]
}]`

When sending a message in chat-ui, I get a message 404 Resource Not Found on the top right of the interface.
When I manually send an HTTP request to the Azure OpenAI API endpoint with the same parameters, I get a valid response.
How can I solve this?

@adhishthite
Copy link
Contributor

@gqoew There's an issue with this in the repo. I have fixed it on my local instance. Please refer here: #1077

@nsarrazin nsarrazin added the support A request for help setting things up label Jun 26, 2024
@gqoew
Copy link
Author

gqoew commented Jun 26, 2024

I'm a bit confused now.

If I understand well, @adhishthite you published a PR 2 months ago with a fix that was solving this. @nsarrazin modified your original fix and merged the PR in the main repo.

Despite this, chat-ui is still not working with Azure OpenAI API with the current docker build and provided MODELS= documentation.

@nsarrazin did you observe the same 404 issue?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
support A request for help setting things up
Projects
None yet
Development

No branches or pull requests

3 participants