NEWS · MODELS · #3020
Cartesia demonstrates SSM-based Sonic and Ink for sub-100ms streaming voice on AWS
An AWS post describes how Cartesia, an AWS Partner, uses State Space Models (SSMs) and AWS infrastructure to run two production streaming voice models—Sonic (text-to-speech) and Ink (speech-to-text)—optimized for sub-100ms first-byte latency and global scale. Sonic is presented as a streaming-native TTS with roughly 90ms to first audio byte and multi-language/voice-cloning features; Ink is positioned as a streaming STT with native turn detection for conversational use cases.
KEY POINTS
- An AWS post describes how Cartesia, an AWS Partner, uses State Space Models (SSMs) and AWS infrastructure to run two production streaming voice models—Sonic (text-to-speech) and Ink (speech-to-text)—optimized for sub-100ms first-byte latency and global scale.
- Sonic is presented as a streaming-native TTS with roughly 90ms to first audio byte and multi-language/voice-cloning features; Ink is positioned as a streaming STT with native turn detection for conversational use cases.
- Lowering TTS/STT first-byte latency to sub-100ms with SSMs addresses a key obstacle for natural, turn-taking voice interfaces and could enable more realistic real-time voice agents at scale.
WHY IT MATTERS
Lowering TTS/STT first-byte latency to sub-100ms with SSMs addresses a key obstacle for natural, turn-taking voice interfaces and could enable more realistic real-time voice agents at scale.