Skip to content

Robo-Linkers/Gesture-controlled-robotic-arm

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

77 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Mudra MK-I

3-DOF Arm

πŸ“š Table of Contents (Click to Expand)


πŸ“– Project Description

Mudra MK-β…  is a gesture-controlled robotic arm developed as an educational and research initiative. It is engineered to automate repetitive tasks through intuitive hand gestures, making it ideal for learning environments and experimentation in human-machine interaction.

The robotic arm features a four-link structure - comprising a base, two articulated links, and an end effector - enabling reliable pick-and-place functionality.

Control is facilitated through a wearable glove interface, equipped with flex sensors and an accelerometer, which translate real-time hand movements into precise robotic actions.

🌱 Mudra MK-β…  marks the beginning of our journey as a student innovation team. As our very first project, it represents not just technical achievement, but a shared vision β€” to explore, learn, and build solutions that bridge creativity and engineering. This is the foundation upon which future ideas will grow.

✨ Features

πŸ€– 4-Link Robotic Arm Structure     ➀ Enables precise and flexible movement

πŸ–οΈ Gesture-Based Control     ➀ Uses flex sensors and an accelerometer for intuitive interaction

πŸ“¦ Pick-and-Place Functionality     ➀ Automates repetitive tasks with ease

🧭 Intuitive User Interface     ➀ Offers seamless and user-friendly control

Note:
The integration of a 4th link between the end effector and the robotic arm is part of our planned system expansion.
In the current release, the design has been optimized for stability, ease of control, and project timelines.
Full 4-link integration, offering enhanced dexterity and extended functionality, is scheduled for future updates.
Further design considerations and future rollout details are outlined in the DESIGN.MD file.


βš™οΈ Installation Instructions

  • πŸ› οΈ For installation instructions and to download the Arduino IDE, visit the Arduino IDE Download Page.
  • Add the ESP32 Library to the ide Instructions
  • To set up the project, follow these steps:
  • Clone the repository:
  • git clone https://github.com/Robo-Linkers/Gesture-controlled-robotic-arm.git
  • Install any necessary dependencies REQUIREMENTS
  • Navigate to the project directory:
  • cd Gesture-controlled-robotic-arm
  • In the src folder, you will find two Arduino code files: Glove.ino and Power_Drive.ino.
    • Upload Glove.ino to the ESP32 board that handles gesture recognition.
    • Upload Power_Drive.ino to the ESP32 board that controls the robotic arm's movements.
  • Before uploading the codes to the boards, make sure to:
    • Edit the relevant fields in both files:
      • Set your WiFi SSID and Password in the code.
      • Adjust any other parameters as necessary for your setup (e.g., GPIO pins, motor controls).

Once you've uploaded both codes to the respective boards, your setup should be ready for further testing.

  • For building the hardware and assembling the robotic arm, refer to the detailed setup and wiring instructions in the DESIGN.MD file. This includes schematics, PCB & hardware designs, and wiring connections necessary to physically construct the system.

πŸš€ Usage Instructions

  • After setting up the hardware and software, wear the glove equipped with sensors, power on the robotic arm, and start performing gestures to control its movements.

    Components

    • Robotic Arm: 4-link structure with servos.
    • Glove Interface: Equipped with flex sensors and an accelerometer
    • Microcontroller: ESP32 or compatible board for processing input signals
    • Power Supply: AC power source for operation.

    Designs

    • For detailed information on the setup, schematics, and design documents related to the glove and robotic arm, refer to the Design Folder. It includes all the necessary diagrams and documentation to help you build the physical system and understand the circuitry.

    Testing

    • The tests folder contains Arduino sketches for testing individual components, including:
      • Flex sensors
      • Dual MPU6050
      • Power electronics (motors, servos)
    • If you encounter any errors, test each component individually to identify the source of the issue.

      It is highly recommended to test each component individually before full assembly to ensure everything is working correctly and to avoid complications during the final integration.


πŸ“‚ Folder Structure

Gesture-controlled-robotic-arm/
β”‚   .gitattributes
β”‚   .gitignore
β”‚   CONTRIBUTING.md
β”‚   LICENSE
β”‚   README.md
β”‚   requirements.txt
β”‚
β”œβ”€β”€β”€assets
β”‚   β”œβ”€β”€β”€icons
β”‚   β”‚       3-dof-arm.png
β”‚   β”‚       bill.png
β”‚   β”‚       binary-code.png
β”‚   β”‚       docs.png
β”‚   β”‚       pcb-board.png
β”‚   β”‚       schematic.png
β”‚   β”‚       testing.png
β”‚   β”‚
β”‚   └───images
β”‚           feature-excluded.png
β”‚           mechanical-assembly-ss-front.png
β”‚           mechanical-assembly-ss.png
β”‚           robotic-arm-front-view.jpg
β”‚           robotic-arm-glove.jpg
β”‚           robotic-arm-side-view.jpg
β”‚           Screenshot 2025-02-11 091135.png
β”‚           Screenshot 2025-02-11 091319.png
β”‚
β”œβ”€β”€β”€designs
β”‚   β”‚   BASE v14.step
β”‚   β”‚   Bill_of_Materials_Electrical.pdf
β”‚   β”‚   Bill_of_Materials_Mechanical.pdf
β”‚   β”‚   BOM.MD
β”‚   β”‚   DESIGN.MD
β”‚   β”‚   Schematic_Glove-Gesture-Controlled-Robotic-Arm_2025-04-26.pdf
β”‚   β”‚   Schematic_Power-Drive-Gesture-Controlled-Robotic-Arm_2025-04-26.pdf
β”‚   β”‚
β”‚   └───Solid-edge
β”‚           BASE-v14-solid-edge.asm
β”‚           BASE-v14-solid-edge.cfg
β”‚
β”œβ”€β”€β”€src
β”‚       Glove.ino
β”‚       Power_Drive.ino
β”‚
└───tests
    β”‚   TESTS.MD
    β”‚
    β”œβ”€β”€β”€Embedded Systems
    β”‚   β”œβ”€β”€β”€COMPLETE
    β”‚   β”‚       COMPLETE.ino
    β”‚   β”‚
    β”‚   β”œβ”€β”€β”€DUAL-MPU6050
    β”‚   β”‚       DUAL-MPU6050.ino
    β”‚   β”‚
    β”‚   └───FLEX-SENSORS
    β”‚           FLEX-SENSORS.ino
    β”‚
    └───Power Electronics
        β”œβ”€β”€β”€complete
        β”‚       complete.ino
        β”‚
        β”œβ”€β”€β”€complete-dynamic
        β”‚       complete-dynamic.ino
        β”‚
        β”œβ”€β”€β”€nema_17_test
        β”‚       nema_17_test.ino
        β”‚
        └───servo_test
                servo_test.ino
.

🦾 Project Showcase

Robotic Arm Front View
Robotic Arm Side View
Robotic Arm Glove View
Robotic Arm Assembly Animation
Watch on YouTube

πŸ”§ Use Cases

πŸ’‘ Manufacturing β†’ Automating repetitive tasks like assembly & packaging
πŸ”§ Remote Operation in Hazardous Environments β†’ Safely handling objects in high-risk areas such as labs or hot zones using remote gesture control πŸŽ“ Education β†’ Demonstrating robotics concepts in academic settings
πŸ§ͺ Research β†’ Exploring human-robot interaction and automation


πŸ›£οΈ Future Plans

  • πŸš€ Integrate the 4th Link

    • Expand the robotic arm with a fourth link between the end effector and arm base to improve dexterity and range of motion.
  • πŸš€ Enhance Gesture Recognition

    • Implement advanced gesture processing algorithms for more fluid and natural control.
  • πŸš€ Wireless Communication Optimization

    • Improve reliability and response time of the ESP32-based communication system.
  • πŸš€ Battery Power Support

    • Add portable power options to make the system independent of a fixed AC supply and make a rechargeable solution for glove.
  • πŸš€ Vision-Based Object Tracking

    • Future iterations may incorporate a lightweight camera module for autonomous object detection and tracking.
  • πŸš€ Mechanical Redesign

    • Refine the mechanical structure for lighter weight and increased durability, including 3D printed or CNC-milled parts.

🀝 Contributing

  • Contributions are welcome! Please feel free to submit a pull request or open an issue if you have suggestions or improvements, for more details refer CONTRIBUTING.

πŸ“œ License

This project is licensed under the MIT License. Refer to the LICENSE file for more details.


πŸ™ Acknowledgments

Engineered by Robo-Linkers πŸ€– 2025

πŸ€– Meet the Team! 🀝


πŸ“§ Contact Information

  • For any inquiries or feedback, please contact us at GitHub, GitLab

πŸ“ Attribution

Robot icons created by Freepik - Flaticon Invoice icons created by Freepik - Flaticon Coding icons created by Freepik - Flaticon Document icons created by Freepik - Flaticon Pcb board icons created by madness - Flaticon Schematic icons created by Iconjam - Flaticon Software development icons created by kliwir art - Flaticon