Gesture Controlled Virtual Mouse

Abstract

Human–computer interaction has evolved significantly with advancements in artificial intelligence (AI) and computer vision. Traditional pointing devices such as the mouse and touchpad are widely used but present challenges in terms of accessibility, portability, and physical limitations. This paper presents a gesture-controlled virtual mouse system that leverages real-time hand gesture recognition to perform mouse operations without physical hardware. The proposed system integrates MediaPipe for landmark-based hand tracking, OpenCV for image processing, and Python libraries such as PyAutoGUI and Pynput for GUI automation. The approach eliminates additional hardware requirements and ensures cost-effectiveness. Experimental results demonstrate successful implementation of functions such as cursor movement, left and right clicks, drag-and-drop, multi-selection, and screenshot capture. The system improves accessibility, offering touchless interaction for users with physical disabilitiesand potential applications in healthcare, education, and hazardous environments.