Welcome to the future of human-computer interaction! The Gesture Controlled Virtual Mouse project utilizes hand gestures and voice commands to operate your computer, creating a seamless experience that feels like magic. This project, fueled by advanced Machine Learning and Computer Vision algorithms, allows users to interact with their devices without the need for direct contact. Let’s dive into how you can set this up and use it effectively!

Getting Started

Before we dive into the steps, let’s lay down some prerequisites to get your environment ready:

• Python: Ensure you have version 3.6 to 3.8.5 installed.
• Anaconda Distribution: You can download it here.

Step-by-Step Installation

Now, let’s get started with the installation process:

  
# Clone the repository
git clone https://github.com/xenon-19/Gesture-Controlled-Virtual-Mouse.git

# Create a new conda environment
conda create --name gest python=3.8.5

# Activate the environment
conda activate gest

# Install necessary packages
pip install -r requirements.txt
conda install PyAudio
conda install pywin32

# Change directory to the source folder
cd path_to_your_cloned_repo/Gesture-Controlled-Virtual-Mouse/src

# Run the voice assistant
python Proton.py 

# Enable gesture recognition
# Command: Proton Launch Gesture Recognition

# For gesture recognition only, uncomment the last lines in Gesture_Controller.py
python Gesture_Controller.py

Understanding the Functionality

This project is designed like a magical wand enchanted to follow your every gesture. Imagine your hand as the controller: each gesture holds a special spell that dictates the action on your screen.

• Neutral Gesture: Think of this as a pause button. It halts the current gesture execution.
• Move Cursor: Just as if you aimed a cursor with your finger, pointing it smoothly to where you want it to go, determines the speed of the movement.
• Left and Right Clicks: A simple flick represents left clicks, while a quick motion could represent right clicks.
• Scrolling: Pinching your fingers together allows you to scroll pages quietly.
• Volume and Brightness Control: With a pinch, you can increase or decrease volume and brightness, considering it a volume control knob.
• Dragging and Dropping: Swipe downwards to grab and move files from one spot to another.

This intuitive interface opens a myriad of possibilities, allowing you to conduct your computer operations like conducting an orchestra!

Troubleshooting Common Issues

If you encounter any issues during setup or operation, don’t fret! Here are some troubleshooting tips:

• Webcam Not Detected: Ensure your webcam is connected and not in use by another application.
• Gestures Not Recognized: Make sure your environment is sufficiently well lit, and your hands are clearly visible to the camera.
• Python Environment Errors: Double-check that you’re using the right conda environment (gest) and that all packages are installed from the requirements.txt file.

For more insights, updates, or to collaborate on AI development projects, stay connected with fxis.ai.

Final Thoughts

With this Gesture Controlled Virtual Mouse, you are not just using your computer; you are engaging with it like never before. This technology showcases the transformative potential of gesture and voice recognition in simplifying human-computer interaction.

At fxis.ai, we believe that such advancements are crucial for the future of AI, as they enable more comprehensive and effective solutions. Our team is continually exploring new methodologies to push the envelope in artificial intelligence, ensuring that our clients benefit from the latest technological innovations.