NEWS · MODELS · #287
MobileDiffusion: subsecond on-device text-to-image generation with a 520M-parameter latent diffusion model
MobileDiffusion is an efficient latent text-to-image diffusion model designed for mobile devices that combines a compact CLIP-ViT/L14 text encoder with a streamlined diffusion UNet and image decoder. By adopting DiffusionGAN for one-step sampling and focusing on architectural efficiency, the 520M-parameter model can produce a 512×512 image in about half a second on tested premium iOS and Android devices.
KEY POINTS
- MobileDiffusion is an efficient latent text-to-image diffusion model designed for mobile devices that combines a compact CLIP-ViT/L14 text encoder with a streamlined diffusion UNet and image decoder.
- By adopting DiffusionGAN for one-step sampling and focusing on architectural efficiency, the 520M-parameter model can produce a 512×512 image in about half a second on tested premium iOS and Android devices.
- Faster, smaller on-device text-to-image models enable real-time mobile user experiences and improved privacy by avoiding server-side inference, making deployment of high-quality generative models on phones more feasible.
WHY IT MATTERS
Faster, smaller on-device text-to-image models enable real-time mobile user experiences and improved privacy by avoiding server-side inference, making deployment of high-quality generative models on phones more feasible.