Google Launches Guided Vision for Gemini Live on Android

Google is launching Guided Vision in Gemini Live on compatible Android devices, bringing real-time audio descriptions to objects viewed through a phone’s camera.

Users can share their camera with Google’s AI to read small text, describe their surroundings, find or identify objects, and hear details about specific items. They can also ask follow-up questions, such as asking Gemini to read an expiration date on an item it helped locate. Google says Gemini can provide audio cues to help users aim the camera when the subject is outside the frame.

Guided Vision is designed for people who are blind or have low vision, as well as those who need assistance in particular situations. The feature is also available in Google TalkBack. Users can set up an accessibility shortcut in Settings on devices running Android 9 and above.

Google cautions that Guided Vision should not be relied on for navigation, safe-travel guidance, or obstacle detection, and is not a replacement for a cane or other mobility aid.