Skip to content

feat(elevenlabs): stream eleven_v3/eleven_v3_conversational via text-to-dialogue - #6838

Open
ameyakhare wants to merge 5 commits into
livekit:mainfrom
ameyakhare:ameya/elevenlabs-v3-dialogue-support
Open

feat(elevenlabs): stream eleven_v3/eleven_v3_conversational via text-to-dialogue#6838
ameyakhare wants to merge 5 commits into
livekit:mainfrom
ameyakhare:ameya/elevenlabs-v3-dialogue-support

Conversation

@ameyakhare

@ameyakhare ameyakhare commented Aug 13, 2026

Copy link
Copy Markdown

Summary

Adds streaming support for eleven_v3 / eleven_v3_conversational by routing them through ElevenLabs' text-to-dialogue API — the regular text-to-speech streaming websocket (multi-stream-input) rejects these models outright today, so SynthesizeStream currently fails for them.

  • ChunkedStream now posts to /v1/text-to-dialogue/stream for these models.
  • New _DialogueConnection mirrors the existing _Connection (same shared-connection, multi-context design for barge-in) but speaks text-to-dialogue's multi-stream-input protocol instead.
  • Waits for the server's is_final_audio_for_turn before sending close_context — sending it immediately, like the regular protocol does, races the server's teardown and silently drops the last turn's audio.
  • Added eleven_v3_conversational to TTSModels (eleven_v3 was already listed but non-functional for streaming).

Quickstart guide here
Websocket documentation here

Testing

  • Lint/format/mypy all pass
  • 16 new unit tests (26/26 total). Verified against the live API for both models — ChunkedStream and SynthesizeStream, including concurrent streams to simulate barge-in.

@CLAassistant

CLAassistant commented Aug 13, 2026

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

@ameyakhare
ameyakhare force-pushed the ameya/elevenlabs-v3-dialogue-support branch from 6d0b6e6 to fa13eaa Compare August 13, 2026 03:58
@ameyakhare
ameyakhare marked this pull request as ready for review August 13, 2026 04:02
@ameyakhare
ameyakhare requested a review from a team as a code owner August 13, 2026 04:02
devin-ai-integration[bot]

This comment was marked as resolved.

devin-ai-integration[bot]

This comment was marked as resolved.

devin-ai-integration[bot]

This comment was marked as resolved.

devin-ai-integration[bot]

This comment was marked as resolved.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants