Every spring, Apple presents a preview of their upcoming software updates for iPhone, iPad, Mac and Apple Watch that focus on accessibility. This year they announced their first software update with 27 new features, including VoiceOver with Apple Intelligence, more natural voice control, accessibility reader improvements, and name recognition.
Despite disappointing sales of the Apple Vision Pro, Apple continues to invest in this device. The arrival of visionOS 27 introduces several accessibility features to the spatial computer, including directions to moving vehicles that can help reduce motion sickness and the control of motorized wheelchairs with Vision Pro. These new accessibility features will be available later this year, along with iOS 27, iPadOS 27, macOS 27 and watchOS 27.
First iOS 27 features
In one press release Apple has announced new accessibility features that will be available later this year. Even though Apple does not mention iOS 27 and iPadOS 27, history tells us that we can assume that the announced feature will become available in major software updates later this fall. We list all the new accessibility features for you.
Apple Intelligence for VoiceOver and Magnifier
For people who are blind or visually impaired, VoiceOver and Magnifier can describe information on the screen and in the environment. Apple Intelligence makes those features even more powerful, with richer descriptions of photos, scanned receipts, personal documents and other visual content.
Also Live Recognition gets an upgrade. This allows VoiceOver users to quickly ask questions about what the camera sees via the action button on the iPhone, after which they receive a detailed answer and can ask follow-up questions in their own words. Magnifier offers the same smart visual support in a high-contrast interface and also works with the action button, plus voice commands such as ‘zoom in’ and ‘turn on the flashlight’.
Voice Control understands natural language
With Apple Intelligence, Voice Control becomes a lot more intuitive: users with physical limitations can now operate iPhone and iPad almost entirely with voice. Thanks to a new, flexible input system, they don’t have to remember exact button labels or numbers; they describe in plain language what is on the screen. The “say what you see” option works in any type of app, including visually complex views like Maps or Files, and lets you issue commands like “type the best restaurants article” or “open the purple folder.” This not only makes navigation easier, but also helps when items are not properly labeled for accessibility.
Voice Control with Apple Intelligence support will first appear in English in the United States, Canada, United Kingdom and Australia, with additional countries available later.
Extension of Accessibility Reader
Accessibility Reader was introduced last year on the iPhone, iPad, Mac and Apple Vision Pro. It is a new reading mode that makes it easier to read text for users with various disabilities, such as dyslexia or visual impairment.
It gives users new ways to customize text and focus on content they want to read, with expanded font and color options, as well as support for spoken content. With Apple Intelligence, this feature becomes even more inclusive and easy to use.
The reader can now handle more complex sources, such as multi-column scientific articles, images and tables, and convert them into a clear, linear text flow. In addition, readers can receive a summary upon request, so they can first view an overview of the article before delving into the details. With the new built-in translation function it is also possible to read texts in your own language without overwriting the custom formatting, font and colors.
Accessibility Reader can be launched from any app and is built into the Magnifier app for iOS, iPadOS, and macOS, allowing users to interact with text in the real world, such as in books or on dinner menus.
Automatically generated subtitles for video
While closed captioning is becoming more common for the deaf and hard of hearing, it is often missing from personal videos and clips from friends and family. The new auto-generated captions feature can now show a transcript of spoken audio when subtitles are not available. This works, for example, with videos from the iPhone, shared by friends or family, or streamed via the internet.
Thanks to speech recognition, subtitles are automatically generated and added locally to videos without subtitles on iPhone, iPad, Mac, Apple TV and Apple Vision Pro. In addition, you can adjust the appearance of the subtitles via the playback menu or settings. Initially, the generated subtitles will only be available in English in the United States and Canada.
Wheelchair control for Apple Vision Pro
For some users of electric wheelchairs, steering with a joystick is not possible. Alternative operating systems are then indispensable for independent movement. Thanks to the precise eye tracking system of the Apple Vision Pro, this is now changing: a new wheelchair controller offers a responsive control method for compatible alternative operating systems. You can see how that works this video.
The eye tracking functionality on Vision Pro does not require major adjustments and works in a variety of lighting conditions. The feature is launching in the US with Tolt and LUCI as the first alternative operating systems, with support for both Bluetooth and wired connections. Apple continues to work with developers to expand support for more wheelchair operating systems.
Other updates
- Sound recognition adds name recognition in fifty countries, a new way for users who are deaf or hard of hearing to know when their name is called.
- Touch adjustments provide a new way to personalize configuration in iOS and iPadOS.
- Directions for moving vehicleswhich can help reduce motion sickness when riding in a moving vehicle, is coming to Vision Pro
- Greater text support is coming to tvOS, allowing viewers with low vision to increase the text size on the screen for easier reading.
- Hikawa Grip & Stand for iPhone (compatible with MagSafe) available worldwide for €54.95. This ergonomic holder is completely designed based on feedback from people with disabilities that make it difficult to hold something stably.
- Sign language in FaceTime: A new API for developers allows a human interpreter to be added to a FaceTime call.
- Improved performance of hearing aids: Smart hearing aids are better connected to your iPhone, iPad and Mac since the 27 updates, making it easier to switch them between devices.
- Those who have difficulty interacting with traditional controllers can now use the Sony Access controller connect as a game controller with iOS, iPadOS and macOS. Users can configure the thumbstick, nine built-in buttons and up to four additional external buttons or special switches to personalize the layout. They can also combine two controllers for a deeply personalized gaming experience.