Google on Wednesday launched Guided Vision, a new accessibility feature in Gemini Live that uses artificial intelligence to help people with low vision navigate their surroundings and interact with the physical world more independently.
The feature, available on compatible Android devices, allows users to point their phone camera at their environment and have Gemini describe what's nearby in real-time. Users can then ask follow-up questions about specific objects or text they want to understand better, making it a powerful tool for daily tasks.
For example, a user could point their camera at a menu in a restaurant and ask Gemini to read it aloud, or point it at a document and ask for a summary of the key points. The feature is designed to help with everyday tasks like reading fine print, identifying products in a store, or understanding signs and labels in unfamiliar environments.
Guided Vision represents Google's latest effort to integrate AI into accessibility tools. The company has been expanding Gemini's capabilities across its product suite, with a particular focus on multimodal features that combine vision, language, and reasoning to create more helpful and context-aware assistants.
The launch comes as tech companies increasingly turn to AI to address accessibility challenges. Microsoft, Apple, and others have been developing AI-powered tools for users with disabilities, from real-time captioning to image descriptions, signaling a broader industry commitment to inclusive design.