Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support OpenAI o1 with streamText({stream: false}) #3153

Open
xl0 opened this issue Sep 27, 2024 · 0 comments
Open

Support OpenAI o1 with streamText({stream: false}) #3153

xl0 opened this issue Sep 27, 2024 · 0 comments

Comments

@xl0
Copy link

xl0 commented Sep 27, 2024

Feature Description

The o1 models do not support streaming at the moment, making them an odd outlier. It would be awesome to still be able to use them with streamText({stream: false}), because this would allow keeping the rest of the front- and back-end code the same for all models. In this case stream in streamText would refer to the fact that the same data streaming protocol is used to send the data back to the front-end.

Use Case

I'm working on (yes, one more) chatbot UI that supports all common models/providers (openai, anthropic, google) and tries to maintain a balance between flexibility/features and ease of use.

o1 models work fine through Open Router because it gives a common interface, and emulates streaming for o1, but supporting o1 through OpenAI would require some work, and it's unclear how long until they support streaming.

Additional context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant