SensorClouds: A Framework for Real-Time Processing of Multi-modal Sensor Data for Human-Robot-Collaboration

Abstract

Human-robot-collaboration (HRC) requires fast and reliable sensor data to ensure the safety of humans in the workspace. Current solutions for processing multi-modal sensor data in HRC are either highly performant in specific scenarios or offer more flexibility at the cost of decreased performance. Our GPU accelerated SensorClouds framework, however, combines both high flexibility and real-time performance. The architecture aids developers in quickly implementing complex HRC applications with multiple sensors by encapsulating all functionality into reusable modules. The resulting pipeline is optimized by the framework and executed in real-time.