If someone you love is losing their sight, you may have noticed a lot of news lately about artificial intelligence that can “look” through a phone camera and describe what it sees. This week, the most-clicked story among blind technology readers in the Top Tech Tidbits newsletter was about Google’s new Guided Vision feature, which blind testers helped build. It’s natural to wonder: could something like this help Mom read her mail, find her glasses, or check a can in the pantry without calling you every time?
The short answer is yes, it can help, and it is getting better quickly. But for many older adults, the app isn’t the hard part. The hard part is the phone it runs on. Here’s what caregivers should know.
What AI “describer” apps can do
- Read printed text out loud, such as letters, bills, menus and package labels.
- Identify everyday objects, colors and paper money.
- Describe a room or a photo in plain words.
- Answer follow-up questions, like “What’s the expiration date?” or “Is this the decaf?”
Google’s October 2026 accessibility update says Guided Vision in Gemini Live can help with reading food labels, identifying colors and finding household objects on compatible Android phones. Other well-known options include Be My Eyes, which also connects people with sighted volunteers, and Microsoft’s Seeing AI.
What they can’t do (yet)
- They are not a mobility aid. Google itself says Guided Vision is not meant for navigation or obstacle detection. Keep the white cane, guide dog and orientation and mobility training.
- They can be wrong. Treat AI as a helper, not the final word, especially with medications. Many US pharmacies can provide talking or large-print prescription labels if you ask.
- They can be long-winded. Some apps describe everything before getting to the point. Asking a specific question (“Read just the dosage”) usually works better.
- Privacy matters. Photos are often processed online. Spend ten minutes together reviewing the app’s privacy settings.
The real barrier: getting to the app
A standard smartphone is built around small icons and finger gestures. Phones do include screen readers (VoiceOver on iPhone, TalkBack on Android), and many blind people use them brilliantly. But for someone in their 80s who is newly coping with macular degeneration or glaucoma, learning a new set of gestures can feel overwhelming.
Before you buy anything, ask yourself:
- Can your parent open the describer app without seeing the screen?
- Can they make and answer calls, and send a text, by voice?
- Who will help when an update changes how things look or work?
- Most importantly, do they want to try it? Involve them in the choice. People stick with tools they helped pick.
Three paths to consider
- A mainstream smartphone plus training. A good fit for people who are comfortable with technology and willing to practice.
- A voice-first phone designed for vision loss. For example, RealSAM Pocket lets the user tap the screen and simply say what they want, with calling, texting, reading text aloud, object identification and Be My Eyes built in. This suits people who would rather talk to their phone than learn gestures.
- A smart speaker at home. Useful for time, weather, reminders and audiobooks, though it can’t read the mail.
Help you may not know about
- Your state vision rehabilitation agency. Every state runs a federally funded program of independent living services for older adults who are blind, and services are often free. They can include in-home assessments and training on phones and other tools.
- Free talking books. The National Library Service for the Blind and Print Disabled (NLS) mails audiobooks and players at no cost to eligible people.
- Help paying for devices. State assistive technology and telecommunications equipment programs sometimes lend or fund accessible phones. We keep a state-by-state list of financial assistance programs. Medicare covers some eye care for conditions like macular degeneration, but generally doesn’t pay for phones or apps.
- Veterans. The VA offers blind rehabilitation services to eligible veterans, including technology training.
Start small
Pick the one task that matters most to your parent, whether that’s reading the mail, calling the grandkids, or knowing what’s in the fridge, and practice it together until it feels easy. Small wins build confidence, and confidence is what keeps someone independent at home a little longer.
