VisonOS Control is a project that aims to recreate the elegant control experience introduced by Apple's VisonOS. This project utilizes computer vision techniques to enable you control your computer mouse through facial and hand gestures, offering a unique and intuitive interaction method.
Control your Computer with facial and hand guestures like we saw at WWDC Apple last year✨
-
Prerequisites:
- Ensure you have Python installed on your system.
- Install the required libraries using
pip install -r requirements.txt.
-
Enable Accessibility (macOS):
- For macOS users, enable accessibility for the application by navigating to "Privacy & Security -> Accessibility" in your settings. Enter your password and turn on accessibility for the application.
-
Run the Application:
- Execute the
main.pyscript to start the VisonOS Control application.
- Execute the
-
Interact with the System:
- Move your face to control the mouse pointer.
- Perform hand gestures, such as the pinch gesture, to trigger actions.
To ensure proper functionality on macOS, it is necessary to grant accessibility permissions to the application. Please follow the steps mentioned above in the "Enable Accessibility (macOS)" section.
Contributions are welcome! If you have ideas for improvements or encounter any issues, feel free to open an issue or submit a pull request.
This project is licensed under the MIT License.