Gesture Controlled Mouse Using Python

EasyChair Preprint no. 12652

Abstract

The technique of establishinga process of interaction between human and conmputer is evolving since the invention of In terms of HCI (Human-Computer Interaetion) technology, the mouse is a fantastic invention. Even while Bluetooth and wireless mouse technology is still in its infancy, it is not entirely device independent. A Bluetooth mouse needs a connected dongle and batteries to function. When a mouse has additional devices, it becomes harder to use The proposcd mouse system is beyond this limitation This project proposes a gesture-controlled mouse using Python, where the user can control the movement of the cursor on the comnuter sereen with hand gestures. The system uses a webcam to capture real-time video input and OpenCV, a computer vision library in Python, to detect and recognize hand gestures. The hand gestures are mapped to the movemnent of the cursor on the screen using PyAutoGUI, a Python library that allows for programmatically controling themouse and keyhoard. The proposcd system aims to interaction, especially for users with physical disabilities or for those who prefer a more natural way of controlling their computer. The system willI be implemented and tested on a Windows platform using Python 3.x, OpenCV 4.x, and PyAutoGUI. The performance and usability of the system will be evaluated through a user study, where participants will be askod to perfornm various tasks using the gesturc-controllcd mouse and provide feedback on their experience. Overall, this pruject aims to demonstrate the potential of using hand gestures as an alternative input method for controlling a computer mouse and tu provide a useful tool for people who have difficulty using traditional input devices

Keyphrases: Mediapipe: For hand tracking and pose estimation., OpenCV: For computer vision tasks such as hand detection and tracking., PyAutoGUI: For controlling the mouse cursor and simulating mouse clicks.

@Booklet{EasyChair:12652,
  author = {Bhavika Darji and Akula Mahesh and Akula Tharun and Akula Harsha and Alladi Bharadwaj},
  title = {Gesture Controlled Mouse Using Python},
  howpublished = {EasyChair Preprint no. 12652},

  year = {EasyChair, 2024}}