iCreatAI News
Skip to content
AWS Machine Learning Blog· Joseph Cottingham·· 24 days agoAI score38

Stream low-latency speech from AI agents using Kokoro TTS on Amazon SageMaker AI

Stream low-latency speech from AI agents using Kokoro TTS on Amazon SageMaker AI

AI summary

This AWS post describes streaming each sentence an agent produces to a hosted Kokoro-82M text-to-speech model on a SageMaker AI real-time endpoint, so synthesis starts on the first sentence instead of waiting for the full response. It covers bidirectional WebSocket handling, an incremental sentence chunker, and two transports for returning audio to the browser, reporting that incremental sending cut mean time to first audio byte from 329.3 ms to 156.7 ms in isolation and made bidi mode 2.4 to 3.5 times faster than batch in a deployed agent.

Source: AWS Machine Learning Blog · aws.amazon.com