Industrial Robot Manipulation using Hand Gesture

Abstract

Industrial robots are becoming increasingly important in manufacturing and assembly operations, and the ability to control them through natural interfaces such as hand gestures is gaining attention as a means to improve their usability and flexibility. The use of hand gestures for controlling robots offers several advantages over traditional methods, such as programming or using a joystick. It is a natural and intuitive way to interact with the robot, reducing the need for extensive training and simplifying the programming process. It also allows for greater flexibility in the use of the robot, as it can respond quickly to changes in the environment and adapt to new tasks. In recent years, significant progress has been made in developing hand gesture recognition systems that can accurately interpret human gestures and translate them into robot commands. These systems typically use cameras or other sensors to capture the hand movements, and machine learning algorithms to recognize and classify the gestures. One of the key challenges in industrial robot manipulation using hand gestures is ensuring that the system is robust and reliable in different environments and under different lighting conditions. This requires careful calibration and testing.In this proposed model, we have used accelerometer sensor (ADXL345) as a tool for detecting the hand gestures and we have used NODEMCU ESP8266 for the communication between the accelerometer sensor and the robot controller. The robot we have used in this project is ABB IR1410 and the controller used is IRC5. The robot is made to move in Cartesian coordinate system that is in XYZ direction using the combination of relays which is being provided as an input to the robot controller. Also the robot can be moved using joint movement where the J1, J2, J3 and J5 axis which can be controlled individually using a ON/OFF switch. The robot can be also brought back to Home position with the help of a push button.