Cloud VR system with immersive interfaces to collect human gaze-controls and interpersonal-behaviors

Abstract

In this study, we present a cloud VR system with immersive interfaces for collecting human gaze-controls and interpersonal-behaviors. Human beings can log in to a VR space and naturally communicate with each other and a robot by using immersive interfaces. An HMD (Head Mounted Display) device and a Kinect sensor provide immersive visualization and motion control, respectively. If users have these devices, they can attend experiments with human-robot interactions in the VR space from around the world. Human gaze-controls and interpersonal-behaviors are collected to database while human beings and a robot interact with each other. The proposed VR system enables to collect huge number of human gaze-controls and interpersonal-behaviors by using immersive interfaces. Application experiments to learn object attributes from human beings and to observe greetings by two persons demonstrate the effectiveness of the proposed VR system to collect human gaze-controls and interpersonal-behaviors.