Real Time Implementation of Virtual Mouse using Computer Vision
1) Mediapipe2) OpenCV
3) math
4) Numpy
MediaPipe is a Framework for building machine learning pipelines for processing time-series data like video, audio, etc. This cross-platform Framework works in Desktop/Server, Android, iOS, and embedded devices like Raspberry Pi and Jetson Nano.
MediaPipe contains MediaPipe Hands, which is a high-fidelity hand and finger tracking solution. It employs machine learning to infer 21 3D landmarks of a hand from just a single frame. It utilizes an ML pipeline consisting of multiple models working together. A palm detection model that operates on the full image and returns an oriented hand bounding box. A hand landmark model that operates on the cropped image region defined by the palm detector and returns high-fidelity 3D hand keypoints as shown below.
This module is used for the detection of hands, to identify their landmarks and to detect their positions.
2) virtual_mouse.pyThis is the main module used is for the real time implementation of virtual mouse, by utilizing handTrackingModule.py.
https://drive.google.com/file/d/1MfvZ1jSLdncAgq_Wnb-7ruPF7NvlRuc3/view?usp=sharing