AssemblyAI details cost-optimized speech-to-text inference on AWS using EC2 Spot
AssemblyAI published an AWS architecture post explaining how it runs large-scale GPU inference for its speech-to-text and analysis API using Amazon ECS with mixed EC2 Spot and On-Demand capacity providers, multi-family GPU Spot diversification (g4/g5/g6), and an SQS-based retry plus Spot interruption handler to requeue in-flight jobs. The deployment spans US West (us-west-2) and Europe (eu-west-2) to meet data-residency requirements and aims to reduce inference costs while preserving SLA and latency guarantees.