You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The o1 models do not support streaming at the moment, making them an odd outlier. It would be awesome to still be able to use them with streamText({stream: false}), because this would allow keeping the rest of the front- and back-end code the same for all models. In this case stream in streamText would refer to the fact that the same data streaming protocol is used to send the data back to the front-end.
Use Case
I'm working on (yes, one more) chatbot UI that supports all common models/providers (openai, anthropic, google) and tries to maintain a balance between flexibility/features and ease of use.
o1 models work fine through Open Router because it gives a common interface, and emulates streaming for o1, but supporting o1 through OpenAI would require some work, and it's unclear how long until they support streaming.
Additional context
No response
The text was updated successfully, but these errors were encountered:
Feature Description
The o1 models do not support streaming at the moment, making them an odd outlier. It would be awesome to still be able to use them with
streamText({stream: false})
, because this would allow keeping the rest of the front- and back-end code the same for all models. In this case stream instreamText
would refer to the fact that the same data streaming protocol is used to send the data back to the front-end.Use Case
I'm working on (yes, one more) chatbot UI that supports all common models/providers (openai, anthropic, google) and tries to maintain a balance between flexibility/features and ease of use.
o1 models work fine through Open Router because it gives a common interface, and emulates streaming for o1, but supporting o1 through OpenAI would require some work, and it's unclear how long until they support streaming.
Additional context
No response
The text was updated successfully, but these errors were encountered: