Some speech providers use
streaming to describe their API’s connection method, for example, a websocket-based API for submitting multiple texts. This concept is different from TTS streaming in Voice Gateway, which refers to audio playout: how quickly synthesized audio starts playing back to the caller.Key Benefits
- Lower response latency. Audio playback starts as soon as the first words are synthesized, instead of after the full text is processed.
- More natural conversation flow. Reduced time-to-first-audio makes voice AI Agent responses feel closer to real-time human conversation, especially with longer text.
Prerequisites
- A voice AI Agent configured.
- A speech service configured in the Voice Gateway Self-Service Portal.
Restrictions
- The following speech providers don’t support TTS Streaming: AWS, Google, Nuance, Speechmatics, and Deepgram Flux.
- TTS vendor fallback doesn’t work with TTS Streaming. If TTS streaming is activated, the fallback vendor configuration is ignored.
- For ElevenLabs, Voice Gateway uses the ElevenLabs streaming API. The following parameters aren’t supported and can’t be specified in Extra Options:
seedprevious_request_idsnext_request_idsapply_text_normalizationapply_language_text_normalizationuse_pvc_as_ivcpronunciation_dictionary_locators
How to Configure TTS Streaming
To activate streaming for your voice AI Agent, follow these steps:1. Configure Speech Service in Voice Gateway Self-Service Portal
1. Configure Speech Service in Voice Gateway Self-Service Portal
- In the navigation menu of the Voice Gateway Self-Service Portal, select Speech.
- On the Speech services page, select an existing speech service or create a new one by clicking Add a speech service in the upper-right corner.
- On the Add Speech service page, make sure that the Use for text-to-speech option is activated.
- Activate the Enable text-to-speech streaming option.
- (Optional) For ElevenLabs, configure the Extra Options field to customize the TTS streaming behavior. See the list of unsupported parameters in the Restrictions section.
- Click Save.
2. Configure the Set Session Config Node in Cognigy.AI
2. Configure the Set Session Config Node in Cognigy.AI
- Go to the Set Session Config Node in your Flow.
- In the Synthesizer (TTS) section, select your speech service from the TTS Vendor list.
- Configure TTS Language and TTS Voice as needed.