Advancing human-robot interaction in a manufacturing environment by incorporating hand movements for remote control

Abstract

Recently, there has been a notable shift in manual assembly tasks being replaced by robots. These robots are controlled by operators using keyboards. To enhance this practice, we have introduced a remote human-robot collaboration system. This system allows operators to remotely control robots using hand gestures, utilizing an online hand gesture recognition system. A model-driven display system has been implemented to complement the remote robot control system.For data acquisition, we have carefully selected Leap Motion technology. The designed approach for remote hand gesture recognition has been implemented and tested for accuracy and response time using the well-known SHREC’21 Gesture Benchmark. The final analysis demonstrates the significant potential of the developed system in improving assembly processes and environments. It optimizes various key performance indicators, leading to enhanced efficiency and effectiveness.