Apple introduced their first spatial computer called Vision Pro, which seamlessly integrates digital content into the physical world, allowing users to remain engaged with their surroundings and connected with others. The official announcement took place on June 5, 2023, and the product will be available in early 2024. What exactly is new with this device, as compared to existing VR headsets? What new possibilities does it enable? Instead of focusing on technical details such as the refresh rate in display, let us focus on the user perspective and compare it with a likely competitor, Meta Quest Pro. Both devices are on the high end. Both are pass-through devices with a video view of the environment so that AR is possible.
1. Control
A very obvious difference is how the devices are operated. While Quest Pro is operated with a pair of controllers, Vision Pro is controlled with voice command, hand gestures, and eyes. In fact, passwords can be replaced by iris recognition.
2. Computer on the Face
Vision Pro is more like a computer on your face. It has the same M2 processor used in Apple laptops. In contrast, Quest Pro’s processor is Qualcomm’s Snapdragon XR2+, a processor specifically for headsets. Vision Pro also has an additional R1 processor for processing camera, microphone, and sensor data.
Quest pro has an Android-based operating system. Vision Pro uses visionOS, a spatial operating system that blends digital content with the physical world. VisionOS has a dedicated App Store, including productivity apps. So in addition to gaming, calling, and entertainment, Vision Pro allows people to get some work done.
Although Quest Pro allows some multitasking, it is not particularly designed for running apps side-by-side. There is low flexibility in positioning and resizing apps. In contrast, Vision Pro is designed for running multiple apps at the same time, spread out in space. It is as if the user has an infinite, private, and portable canvas for apps. Users can move and resize apps. Resizing is particularly attractive when users want a large screen for playing movies.
3. Display
Speaking of movies, it is noteworthy that Vision Pro has about 23 million pixels, as compared to about 7 million pixels in Quest Pro (1920X1800 in each eye).
4. Taking Pictures
Vision Pro can take 3D photos and videos. Users may relive the moments captured in an immersive way. Quest Pro can not take photos or videos.
5. Video Conferencing
Vision Pro can make FaceTime calls more natural with life-size video tiles and app collaboration. A user may use the device’s front cameras to scan face to create an avatar, then the avatar is animated in real time according to head, eye, and hand inputs tracked by the headset.
6. External Display
Vision Pro shows the user’s eyes by an external display, which might look more natural to other people.
While Vision Pro has multiple advantages, Quest Pro gives access to many highly rated games and is particularly good with fitness programs. Needless to say, Quest Pro’s $1000 price point seems like a bargain, compared with the $3,499 price tag by Apple.
Link: Apple Webpage, Video
Location: California, US
Summary
The Purpose
To make VR/AR operation more natural
The Idea
Track eyes and hands. Use voice command
Further Possibilities
1. Have a platform for people to generate XR content with just hands and voice
This platform would lower the barrier to entry and make content creation more intuitive and immersive. It would enable a wider range of people, including those who may have limited experience with traditional input devices, to express their creativity and contribute to the growing world of VR/AR experiences.
2. Use the eye-tracking technology to monitor eye health conditions
Eye-tracking can assist ophthalmologists in assessing eye health, tracking disease progression, and evaluating treatment outcomes.
3. Have virtual parties
Virtual parties in VR/AR offer a unique and immersive way for people to connect, celebrate, and have fun together, transcending physical limitations and providing new opportunities for social interaction and entertainment. Now that Vision Pro allows a digital recreation of the wearer that reacts in real time, virtual parties will feel more natural with rich social dynamics and shared experiences.
4. Enable immersive collaborative work
VR/AR offers enhanced visualization capabilities, enabling teams to view and manipulate 3D models, designs, and prototypes in an immersive manner. With productivity apps in Vision Pro, there will be more efficient and intuitive collaboration in fields like architecture, engineering, product design, or scientific research. Team members may examine and discuss intricate details, provide feedback, and make real-time modifications, improving the overall quality and efficiency of the work.
5. Make 3D movies of one’s life
The creation of 3D movies of one's life provides a novel and immersive way to document, preserve, and relive personal experiences. It combines the power of visual storytelling, technology, and memory preservation to create a richer and more engaging narrative of one's life journey. Such capabilities enable virtual time travel.
Questions
1. How might companies sell products in this new VR/AR system?
2. How might we use generative AI to make VR/AR more attractive?
3. What might be all the ways to use the 3D capabilities in the VR/AR?
