Communication with a Semi-Autonomous Robot Combining Natural Language and Gesture

Abstract

The Intelligent Multimodal Multimedia and the Adaptive Systems Groups at the Navy Center for Applied Research in Artificial Intelligence have been investigating a natural language and gesture interface to a mobile robot. Our interface utilizes robust natural language understanding and resolves some of the ambiguities in natural language by means of gesture input. The natural language and gestural information is integrated with knowledge of a particular environment and appropriate robotic responses are