Apple Unveils AI-Powered Accessibility Updates
Apple is integrating its proprietary Apple Intelligence into a suite of new accessibility tools designed to assist users with vision, hearing, and mobility impairments. The company announced these features ahead of the annual Google I/O developer conference, signaling a major push to leverage on-device AI for inclusive technology.
The update spans across multiple hardware platforms, including iPhone, iPad, Mac, and Apple Vision Pro. Among the most significant additions is a specialized control system for mobility-impaired users.
New Mobility and Vision Tools
Vision Pro users will soon gain the ability to operate compatible wheelchairs using only their eye movements. Apple confirmed that this system functions across varying lighting conditions without the need for constant recalibration. The project is launching in the U.S. with support for Tolt and LUCI alternative drive systems, accommodating both wired and Bluetooth connections.
For individuals with low vision, VoiceOver is receiving a significant upgrade in image recognition. The AI can now parse complex documents, such as bills, to read out specific data like due dates and total amounts. Additionally, users can leverage the iPhone camera for Live Recognition, allowing them to ask follow-up questions about items in their physical environment. The Magnifier app also gains a high-contrast mode, which can be mapped directly to the iPhone’s Action button.
Advanced Navigation and Content Processing
Apple is expanding voice control capabilities beyond simple system commands. Users can now use natural language to interact with screen elements. Examples include commands like “Tap the purple folder” in the Files app or “Tap the guide about best restaurants” within Apple Maps.
The Reader tool on Mac and other devices is also receiving an overhaul to better manage complex documents, including scientific papers containing tables and multi-column layouts. Users will be able to generate AI-powered summaries while retaining original formatting, fonts, and colors—a feature specifically tailored for those with dyslexia or low vision.
Subtitles and Hearing Support
To address the needs of users with hearing impairments, Apple is introducing:
- AI-Generated Subtitles: Automatically creates captions for any video, including personal recordings or clips shared by friends, across all Apple devices.
- Enhanced Name Recognition: Now supports 50 languages to notify users when their name is spoken.
- Improved Handoff: Better device switching for “Made for iPhone” hearing aids.
- tvOS Updates: Expanded support for large text across the television interface.
These features are expected to roll out to the public later this year, likely arriving as part of the upcoming iOS 27 release.