Apple is set to introduce a new feature called Apple Intelligence to its Vision Pro headset with an upcoming update to its operating system, visionOS 2.4. This announcement was made on Friday, and the update will bring Apple’s generative AI platform to the headset. Currently, a test version of this software is available for developers, while the public version is expected to be released in April.
Just like how Apple has rolled out updates for the iPhone and Mac computers, the Vision Pro will also receive these updates in stages. The first batch of features will include tools that help users create text and images. Some of the new features include options to rewrite text, proofread it, and summarize longer pieces of writing. Apple believes that these tools will be essential for helping users work more efficiently on the device.
It’s important to note that Apple has described the Vision Pro as a “spatial computing” device from the beginning. This means that, in addition to providing entertainment options like videos and games, the company wants to emphasize that the Vision Pro is meant to enhance traditional computer work. TechCrunch, a technology news site, has referred to it as “The infinite desktop,” highlighting its potential to expand how we think about working with computers.
Currently, typing on the Vision Pro can be a bit tricky. Users have to look at a letter on a virtual keyboard and then pinch their fingers together to select it. While this method works, it can be cumbersome if someone wants to write more than just a few words. Voice typing can help with this issue, and Apple has recently improved its voice assistant, Siri, to make it even better for users of the Vision Pro.
Apple is hoping that by combining voice commands with its new AI writing tools, users will find it easier to use the Vision Pro as part of their daily tasks. For example, features like Message Summaries and Smart Reply for emails will help users interact with different applications without getting distracted from what they are doing.
Another exciting feature called Image Playground will allow users to create images using voice commands. This feature will be part of the Photos app on the Vision Pro, making it easy for users to generate images just by speaking.
These features have already been available on other Apple devices like iPhones and iPads, so there aren’t any brand-new features specifically for the Vision Pro in this update.
In addition to the visionOS 2.4 update, Apple is also launching a new Vision Pro app for iPhones, which will be available with the iOS 18.4 update, currently in beta. This app serves several purposes, but its main function is to allow users to browse content for the Vision Pro, such as TV shows and movies, and then transfer that content to the headset. This is a useful feature since wearing the headset for long periods can be uncomfortable and drain the battery quickly. So, being able to scroll through content on an iPhone is a more comfortable option.
When the iPhone is unlocked and close to the headset, the new app can also help manage guest accounts. If someone tries to sign in as a guest on the Vision Pro, the headset will notify its owner, and the new app will let the owner see what the guest is viewing inside the headset.
