By Apple has unveiled an innovative method of interacting with apps using hand gestures through its debut mixed-reality headset, the Vision Pro. These intuitive controls, which include moving windows and resizing documents, have been a standout feature of the device’s operating system, visionOS. A patent filed by the Cupertino-based tech giant suggests that Apple may be planning to extend this technology to other devices in its product lineup.
Apple’s Vision Pro Gestures May Soon Be Available on iPhone, iPad, and Mac
- The patent titled “Devices, Methods, And Graphical User Interfaces For Using A Cursor To Interact With Three-Dimensional Environments” details a system where hand movements can control various devices.
- This indicates Apple’s potential plans to extend these gesture controls from the Vision Pro headset to iPhones, iPads, and Macs.
- Detailed diagrams of the Vision Pro and its components imply the device could recognize and transmit user gestures to other Apple products.
- The patent includes illustrations of users interacting with traditional iPads and desktop computers using similar hand movements, further suggesting this technology could soon be integrated across Apple’s device ecosystem.
Apple’s Vision for Gesture Control Extends Beyond VR and AR
- This patent underscores Apple’s broader vision for gesture control, aiming to integrate it beyond virtual and augmented reality into everyday device interactions.
- With existing facial recognition features on iPhones and iPads, incorporating hand gesture recognition appears to be a natural next step.
- The company’s recent emphasis on gaze-based navigation in iOS 18 further aligns with this trend.
- Apple is laying the groundwork for a future where users can interact with multiple devices using intuitive hand gestures, as highlighted by this patent.
- The patent details the ability to differentiate between intentional gestures and casual hand movements. Once a gesture is verified, the system can execute actions like moving a cursor or resizing windows.
- Though the patent focuses on technical specifics, it hints at a hands-free interaction system, which could serve as an alternative to touchscreen Macs, aligning with Apple’s stance against them.
