Apple integrates Apple Intelligence into core accessibility tools ahead of Global Accessibility Awareness Day
The tech giant has unveiled a suite of updates including on-device subtitle generation, natural language voice control, and power wheelchair integration for Apple Vision Pro, all scheduled for release later this year.
Apple has announced a comprehensive suite of accessibility enhancements powered by Apple Intelligence, timed to coincide with the lead-up to Global Accessibility Awareness Day on 21 May. The updates integrate artificial intelligence capabilities into core tools such as VoiceOver, Magnifier, Voice Control, and Accessibility Reader, aiming to improve navigation and information processing for users with disabilities. Chief Executive Tim Cook stated that the company is bringing powerful new capabilities into these features while maintaining its foundational commitment to privacy by design.
For users who are blind or have low vision, VoiceOver’s Image Explorer now utilises Apple Intelligence to provide detailed, system-wide descriptions of images, including photographs, scanned bills, and personal records. Updates to Live Recognition allow users to press the iPhone Action button to ask questions about the camera viewfinder and receive detailed responses, with support for follow-up queries. Similarly, Magnifier now features a high-contrast interface and uses the same AI technology to assist users with low vision, enabling them to ask questions via the Action button and control the app with spoken requests.
Voice Control has been updated to support natural language input, allowing users with physical disabilities to navigate iPhone and iPad entirely by voice. Instead of memorising exact labels or numbers, users can describe onscreen elements using intuitive language, such as “tap the purple folder.” This flexible input method is designed to help users overcome barriers when elements are not properly labelled for accessibility, particularly in apps with complex visual layouts.
Accessibility Reader can now handle more complex source material, including scientific articles with multiple columns, images, and tables. The feature includes on-demand summaries and built-in translation that retains custom formatting, font, and colours. Additionally, Apple introduced on-device generated subtitles for uncaptioned video content across the Apple ecosystem, including iPhone, iPad, Mac, Apple TV, and Vision Pro. This process relies on on-device speech recognition to maintain user privacy while automatically transcribing spoken audio for personal clips and streamed content.
A significant innovation for Apple Vision Pro users is a new power wheelchair control system that leverages the headset’s precision eye-tracking technology. This feature offers a responsive input method for compatible alternative drive systems, initially supporting Tolt and LUCI systems in the U.S. with both Bluetooth and wired connection support. Apple noted that eye tracking on the device does not require frequent recalibration and functions in various lighting conditions.
In parallel with the software announcements, the Hikawa Grip & Stand for iPhone, an adaptive MagSafe accessory, is now available globally in three new colours. Developed in collaboration with PopSockets and designer Bailey Hikawa, the accessory is designed to assist users with a wide range of disabilities affecting grip, strength, and mobility. A Today at Apple session featuring Hikawa, author Shane Burcaw, and actor Alex Barone is scheduled for 20 May at Apple The Grove in Los Angeles to discuss the role of iPhone as assistive technology.
