ROS integrated object detection for SLAM in unknown, low-visibility environments

Abstract

Integrating thermal (or infrared) imagery on a robotics platform allows Unmanned Ground Vehicles (UGV) to function in low-visibility environments, such as pure darkness or low-density smoke. To maximize the effectiveness of this approach we discuss the modifications required to integrate our low-visibility object detection model on a Robot Operating System (ROS). Furthermore, we introduce a method for reporting detected objects while performing Simultaneous Localization and Mapping (SLAM) by generating bounding boxes and their respective transforms in visually challenging environments.