Computational intelligence for human-friendly robot partners based on multi-modal communication

Abstract

This paper discusses the multi-modal communication for robot partners based on computational intelligence in informationally structured space. First, we explain recognition methods of touch interface, voice recognition, human detection, gesture recognition used in the multi-modal communication. Furthermore, we propose a conversation system to realize the multi-modal communication with a person. Finally, we show several experimental results of the proposed method, and discuss the future direction on this research.