Charlie Rides the Elevator -- Integrating Vision, Navigation and Manipulation towards Multi-floor Robot Locomotion

Abstract

This paper presents the design, implementation and experimental evaluation of a semi-humanoid robotic system for autonomous multi-floor navigation. This robot, a Personal Robot 2 named Charlie, is capable of operating an elevator to travel between rooms located on separate floors. Our goal is to create a robotic assistant capable of locating points of interest, manipulating objects, and navigating between rooms in a multi-storied environment equipped with an elevator. Taking the elevator requires the robot to (1) map and localize within its operating environment, (2) navigate to an elevator door, (3) press the up or down elevator call button, (4) enter the elevator, (5) press the control button associated with the target floor, and (6) exit the elevator at the correct floor. To that end, this work integrates the advanced sensorimotor capabilities of the robot - laser range finders, stereo and monocular vision systems, and robotic arms - into a complete, task-driven autonomous system. While the design and implementation of individual sensorimotor processing components is a challenge in and of itself, complete integration in intelligent systems design often presents an even greater challenge. This paper presents our approach towards designing the individual components, with focus on machine vision, manipulation, and systems integration. We present and discuss quantitative results of our live robotic system, discuss difficulties faced and expose potential pitfalls.