NEWS · STARTUPS · #864
Modal rebuilds sandbox infrastructure to scale 1 million concurrent sandboxes in seconds
Modal engineers rebuilt their sandbox platform to avoid centralized coordination (e.g., etcd-backed Kubernetes control planes), making each worker the source of truth and running many parallel schedulers. In benchmarks the new architecture created 1 million sandboxes in under a minute with median startup-to-code under 0.5s and sustained tens of thousands of sandbox creations per second.
KEY POINTS
- Modal engineers rebuilt their sandbox platform to avoid centralized coordination (e.g., etcd-backed Kubernetes control planes), making each worker the source of truth and running many parallel schedulers.
- In benchmarks the new architecture created 1 million sandboxes in under a minute with median startup-to-code under 0.5s and sustained tens of thousands of sandbox creations per second.
- Shows a concrete alternative to extending Kubernetes for GenAI-scale workloads by decoupling coordination from execution and demonstrating sub‑second isolation at million‑sandbox scale.
WHY IT MATTERS
Shows a concrete alternative to extending Kubernetes for GenAI-scale workloads by decoupling coordination from execution and demonstrating sub‑second isolation at million‑sandbox scale.