Humanoid with Interaction Ability Using Vision and Speech Information

Abstract

Computer Vision 126 technologies studied in our institute. The following functions are implemented for humanrobot interaction: 1. Speech recognition 2. Voice synthesizing 3. Facial information measurement 4. Portrait drawing 5. Gesture recognition The dialogue system which use a large vocabulary continuous speech recognition, and the eye contact system, which use a facial information measurement system, are the unique features of this robot. The rest of this paper is organized as follows: First, the design concepts are discussed in Section 2. The hardware and software system configuration are described separately in Section 3. In Section 4, the voice interface implemented in this system is explained. The interaction modules using visual information are explained in Section 5. In section 6, are explained the demonstration and the experiment in which a person interacts with the humanoid. Finally, we summarize our research and future works in Section 7.