Skip to content

Address streaming responses incongruences #7180

@mudler

Description

@mudler

LocalAI version:
3.7.0

Environment, CPU architecture, OS, and Version:

Describe the bug
It seems that the way streaming is implemented in LocalAI breaks some clients, such as sst/opencode#3994 , and see also: #1194

To Reproduce
N/A yet

Expected behavior
Both opencode and other software using streaming token should work

Logs

Additional context

Metadata

Metadata

Assignees

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions