PARTNERSHIP · MODELS · #1367
Google launches Guided Vision in Gemini Live for real-time conversational visual assistance on Android
Google has launched Guided Vision in Gemini Live on compatible Android devices (Android 9+), a voice-forward feature that provides real-time audio descriptions, object localization, and reframing cues when users share their camera. Developed with blind and low-vision communities and trained in partnership with Aira (including tens of thousands of hours and over 1,000 Trusted Testers), Guided Vision supports multiple languages and integrates with Android accessibility shortcuts and TalkBack, while noting it is not a medical device or a navigation/mobility replacement.
KEY POINTS
- Google has launched Guided Vision in Gemini Live on compatible Android devices (Android 9+), a voice-forward feature that provides real-time audio descriptions, object localization, and reframing cues when users share their camera.
- Developed with blind and low-vision communities and trained in partnership with Aira (including tens of thousands of hours and over 1,000 Trusted Testers), Guided Vision supports multiple languages and integrates with Android accessibility shortcuts and TalkBack, while noting it is not a medical device or a navigation/mobility replacement.
- This extends conversational, camera-based assistive AI to blind and low-vision users at scale, improving everyday accessibility while raising typical safety and accuracy caveats for vision-based generative systems.
WHY IT MATTERS
This extends conversational, camera-based assistive AI to blind and low-vision users at scale, improving everyday accessibility while raising typical safety and accuracy caveats for vision-based generative systems.
SOURCES & TIMELINE
2Built alongside the blind and low-vision community, Guided Vision in Gemini Live offers conversational, real-time visual assistance. Share your camera to receive dynamic audio descriptions and natural verbal reframing cues to explore your environment. Today, we’re launching Guided Vision in Gemini Live across compatible Android devices — bringing voice-forward, real-time visual interpretation to people who are blind…
People with low vision can use Guided Vision to have Gemini describe what’s nearby and ask follow-up questions. Guided Vision is launching in Gemini Live on compatible Android devices today to use AI to give real-time audio descriptions of anything you point your phone’s camera at. By sharing your camera in Gemini Live, you can have Google’s AI help with things like reading small text, describing your surroundings, …