Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Together.ai LLM Provider #282

Open
officiallymarky opened this issue Apr 28, 2024 · 2 comments
Open

Add Together.ai LLM Provider #282

officiallymarky opened this issue Apr 28, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@officiallymarky
Copy link

I can get Together.ai working through OpenAI emulation, but you have a lot of providers, having a specific one for Together.AI and maybe even a way to select models without having to type them all in would be awesome.
@nhaouari nhaouari added the enhancement New feature or request label May 2, 2024
@ckt1031
Copy link
Contributor

ckt1031 commented May 2, 2024

It has OpenAI compatibility API
Use the OpenAI Chat provider is ok

https://docs.together.ai/docs/openai-api-compatibility

@officiallymarky
Copy link
Author

It has OpenAI compatibility API Use the OpenAI Chat provider is ok

https://docs.together.ai/docs/openai-api-compatibility

I understand that, and I did get it working for that, it just would be nice to have a dedicated option for it since it is very popular and have the largest selection of open source models for reasonable price.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@nhaouari @officiallymarky @ckt1031