Real-time ground-plane based mobile localization using depth camera in real scenarios

Abstract

Existing robot localization methods often rely on particular characteristics of the environment, such as vertical walls. However, these approaches loose generality once the environment does not show that structure, e.g., in domestic environments. This paper addresses the problem of absolute online self-localization in a known map, where the only required structure in the environment is a planar ground. In particular, we rely on the transitions between the ground and any other non-planar structure. The approach is based on the ground point-cloud and plane model perceived by a depth-camera. The ground detection algorithm is robust to small shifts on camera orientation during the robot motion, by determining the calibration parameters on-the-fly. Then the edges of the ground are estimated, which can be originated by obstacles in the environment. The localization is obtained using a particle filter fusing to odometry with a novel observation model reflecting the quality of the match between the ground edges and the nearest obstacles. For this purpose, a cost function was implemented based on a distance-to-obstacles grid map. Experimental results using the ISR-CoBot robot are presented, ran in different scenarios, including a bookshop during working hours.