Improving human-robot interaction by a multimodal interface

Abstract

This paper describes a multimodal interface that combines ocular information, through electrooculography, and haptics information, with a desktop-based haptics feedback device. Two control strategies are defined in order to test the advantages of multimodal interaction with an external device, in this case a robot arm from Fanuc. Three applications have been designed using the previously described control strategies. These applications are aimed at studying the usefulness of this kind of interfaces as a substitute of classical man-machine devices.