UAV human teleoperation using event-based and frame-based cameras

Abstract

Teleoperation is a crucial aspect for human-robot interaction with unmanned aerial vehicles (UAV s) applications. Fast perception processing is required to ensure robustness, precision, and safety. Event cameras are neuromorphic sensors that provide low latency response, high dynamic range and low power consumption. Although classical image-based methods have been extensively used for human-robot interaction tasks, responsiveness is limited by their processing rates. This paper presents a human-robot teleoperation scheme for UAVs that exploits the advantages of both traditional and event cameras. The proposed scheme was tested in teleoperation missions where the pose of a multi rotor robot is controlled in real time using human gestures detected from events.