visionOS 27 adds Siri AI and more Apple Intelligence features to the Apple Vision Pro

During WWDC, Apple presented visionOS 27, the next major software update that makes the Vision Pro even smarter and more versatile. This version places a strong focus on the new generation of Apple Intelligence, with which the spatial computer understands much more context of both your digital workspace and your physical environment. Users can count on deep AI integrations that immediately make spatial computing a lot faster and more intuitive.

In addition to the powerful new assistant, Apple is introducing various visual and practical improvements for the daily use of the Vision Pro. From beautifully curved application windows to completely new environments and significantly faster Wi-Fi connections. Below you will find a complete overview of all the new features and options available in visionOS 27 on the Apple Vision Pro.

Apple Vision Pro not yet in Dutch

The Apple Vision Pro is currently not officially available in the Netherlands and Belgium, and visionOS does not support the Dutch language. Anyone who still wants to get started with the Vision Pro can move within the European Union to a country where Apple does sell the device, such as Germany or France, and purchase it there and use it in, for example, English, German or French.

Siri AI and Visual Intelligence

With visionOS 27, the Apple Vision Pro gets a completely new Siri AI that is powered by the latest generation of Apple Intelligence. This smart assistant now has screen awareness and uses Visual Intelligence, allowing you to easily ask questions about objects in your physical or digital environment just by looking at them.

visionOS 27 adds Siri AI and more Apple Intelligence features to the Apple Vision Pro

Plus, you can place a three-dimensional Siri widget anywhere in your space and instantly start a conversation without having to give a voice command. Unlike iOS 27 and iPadOS 27, Siri AI available are on the Apple vision Pro with M5 chip and in the EU.

Notifications and Control Panel

Managing notifications just got a lot easier with the arrival of eye-controlled notifications in visionOS 27. As soon as a notification pops into your field of view, you can simply look at it to immediately expand it and take action. In addition, the Control Center has been completely redesigned and clearly divided into three clear sections: notifications, control center and your virtual environments.

Arched windows

Applications like Safari, Freeform and Apple TV now support curved windows that fold around you like a large curved monitor. The feature is designed to create a more immersive workspace and make better use of Vision Pro’s virtual viewing area. Within Safari, you’ll also enjoy the new ability to view fully immersive web experiences with 360-degree backgrounds.

Connectivity and Mac integration

In visionOS 27, the Vision Pro connects to WiFi networks up to three times faster, which directly benefits the performance of heavy streaming and cloud applications. At the same time, a new virtual display widget makes it possible to seamlessly connect to your Mac with one tap, even when the laptop is closed. Designers can also view, edit and annotate three-dimensional models directly from their Mac in their spatial environment.

New environments and panoramic photos

Users can now convert their own panoramic photos from the Photos app into spatial scenes and set them up as a personal, immersive environment. Apple is also introducing the brand new Thórsmörk environment, based on the Icelandic highlands, complete with the Northern Lights and dynamic colors. When you watch a video in this icy environment, the colors of the screen reflect realistically on the snow and water surface for extra immersion.

New Widgets

A new, extra-small widget size allows users to fit more widgets into their physical environment without overwhelming it. This additional size option gives users more flexibility in positioning clocks, weather widgets, photos, and other persistent spatial content.

Accessibility options and wheelchair controls

Thanks to the arrival of visionOS 27, the Apple Vision Pro can now be used as an advanced, hands-free operating system for compatible electric wheelchairs. This new accessibility feature uses the high-precision eye tracking system on Vision Pro, allowing users with severe physical disabilities, such as ALS, to determine the direction and movement of their wheelchair simply by steering with their eyes. You can see how that works this video.

The Vision Pro connects via Bluetooth or cable to supported drive systems from specialist manufacturers such as Tolt and LUCI. A major advantage of this integration is that the sensor technology works reliably under different lighting conditions and does not have to be recalibrated after the initial setting.

The Dwell Control option for eye movements has been greatly improved in this version, allowing users to confirm a selection instantly by looking at a marker instead of waiting for a timer.

Finally, a useful feature has been added to effectively reduce motion sickness when using the headset as a passenger in a car.

Availability visionOS 27

visionOS 27 will be released this fall and can be downloaded on all Apple Vision Pro models, but only the Vision Pro with M5 chip can use ‘powerful on-device model‘ for Apple Intelligence.

Recent Articles

Related Stories