Google open-sources ML Drift GPU engine for on-device AI inference
Google released ML Drift, an Apache-2.0 open-source, cross-platform GPU compute engine for on-device AI and ML inference that abstracts multiple low-level APIs (OpenGL ES, OpenCL, Metal, WebGPU). ML Drift powers LiteRT, adds unified shaders via tensor virtualization, extensible custom ops, 5D tensor support, and hardware-specific optimizations for Arm, Intel, and Qualcomm GPUs; Google says it replaces the legacy TensorFlow Lite GPU delegate and reports lower memory overhead and app-level latency improvements in Chrome, YouTube Shorts, Photos, Adobe apps, and Snapchat.