Apple integrates on-device AI into accessibility suite across iOS 27
New features include AI-generated subtitling, enhanced VoiceOver descriptions, and Vision Pro integration with wheelchair drive systems, with full rollout expected later this year.
Apple has announced a comprehensive update to its accessibility ecosystem across iPhone, iPad, Mac, Apple TV, and Vision Pro platforms, leveraging on-device AI processing via Apple Intelligence. The announcements, made ahead of Google’s annual developer conference, introduce significant upgrades to VoiceOver, Live Recognition, and real-time captioning, with the full suite expected to launch later this year as part of the iOS 27 release.
A key addition is the introduction of AI-generated subtitling for any video, utilising on-device speech recognition. This feature will be available across iPhone, iPad, Mac, Apple TV, and Apple Vision Pro, providing captions for content that previously lacked them. The update also enhances VoiceOver’s Image Explorer, which will use AI to add more details to image descriptions. However, Apple has issued a specific warning that these AI-generated descriptions should not be relied upon in risky or potentially dangerous situations. Users can also now ask questions about what the camera sees by pressing the Action button.
Further enhancements include natural language navigation capabilities in Voice Control and improved summarisation capabilities in Accessibility Reader, allowing the tool to handle more complex material. For hearing assistance, name recognition now supports 50 languages, and Made for iPhone hearing aids have seen improved handoff capabilities. Additionally, a new API will allow sign language interpreters to be brought into FaceTime calls, and larger text support is being added to tvOS.
For Vision Pro users, the eye-tracking system can now link to wheelchair drive systems, including Tolt and LUCI in the US, via Bluetooth or a hardwired connection with the Developer Strap. The headset will also introduce Vehicle Motion Cues, designed to reduce motion sickness for users in moving vehicles. These mobility-focused updates represent a significant step in integrating assistive technology with spatial computing hardware.
In a non-AI update, Apple has made the MagSafe-compatible Hikawa Grip & Stand available worldwide via the Apple Store starting today in three colours. The full suite of accessibility updates, underpinned by Apple Intelligence, marks a substantial expansion of the company’s tools for users with mobility, visual, and hearing impairments.
