On field gesture-based human-robot interface for emergency responders

Abstract

Coordination and control of rescue robots is a hard task, especially in harsh and hazardous environments, that potentially limit both the mobility and endurance of the robots and the safety of a human interaction. In this paper we provide a fast, flexible and cost effective framework for human-robot interaction specifically designed for the on-field interaction of human operators and robots, using as input a cheap Microsoft Kinect camera. The proposed architecture is based on a quick and cost effective gesture recognition algorithm developed in LabView and integrated into a ROS based communication framework that allows to decouple the mobile robot and the user terminal. The proposed architecture has been tested simulating harsh conditions by considering darkness, smoke, crowds, and user wearing firefighter uniforms.