visionOS 27: What's New in the Vision Pro Operating System
In addition to iOS 27, macOS 27, and others, Apple announced an update to visionOS 27. There are many small improvements, for example, in environments and AI.
Panorama as Spatial Scene under visionOS 27: Can also be made into an environment in the future.
(Image: Apple)
Not only iOS and iPadOS 27 and macOS 27 alias Golden Gate did Apple show at yesterday's WWDC keynote, but the operating system for the Vision Pro also received an upgrade, which logically is called visionOS 27. Apple is pursuing classic product maintenance with the software, but is also delivering some features that users of the mixed-reality headset have been wishing for for a long time.
Environments and Siri AI
For the first time, it is possible to define custom environments, i.e., 3D environments that serve as a background for the Vision Pro. For this purpose, a “Special Scene” is created from panoramas taken with the iPhone using AI and mathematics, which can be viewed in 3D and also used as an environment. How well this will look in terms of resolution compared to Apple's original environments remains to be seen. For the latter, there is at least a new one, namely “Thórsmörk,” a view from Iceland with the Northern Lights and changing lighting conditions.
Videos by heise
Siri AI is to be available for the Vision Pro from the start, along with the internal improvements in Apple Intelligence. Visual intelligence is also coming to the Vision Pro, capable of analyzing images on websites but also interacting with objects in the room. As an example, Apple cited whether a pair of hiking boots would fit into a bag in the Vision Pro's field of view – Siri AI then indicated that it would be tight but possible. Siri AI can also be placed in the room in the form of a sphere; if you look at the sphere, you can start speaking, so you don't have to say “Hey Siri” separately. A Siri app for visionOS will also be available. Siri AI knows the user's personal context and can control more apps than before. The AI functions in Safari are also available on the Vision Pro (e.g., tab sorting), and the new Image Playground is also landing on the headset (image generator).
Curved Windows, New Quick Look, 3D Models from Mac
Useful: 3D models from the Mac, which can be viewed via Mac Virtual Display, can now be brought into visionOS and placed in the room. Finally, visionOS 27 can also display windows curved (e.g., in Safari or Freeform), Quick Look displays wireframes of 3D objects on request, and the control center has been revised. Notifications can be expanded to full size with a glance, and Wi-Fi connections have become faster. Apple Maps comes with new aerial images that are said to look more realistic.
visionOS 27 will be released along with the other new operating systems in the fall. Developers can already test a developer preview version, which has been available for download since Monday evening. It is advisable to create a backup beforehand.
Empfohlener redaktioneller Inhalt
Mit Ihrer Zustimmung wird hier ein externer Preisvergleich (heise Preisvergleich) geladen.
Ich bin damit einverstanden, dass mir externe Inhalte angezeigt werden. Damit können personenbezogene Daten an Drittplattformen (heise Preisvergleich) übermittelt werden. Mehr dazu in unserer Datenschutzerklärung.
(bsc)
