Human-Robot Collaborative Learning System for Inspection

Abstract

This paper presents a collaborative reinforcement learning algorithm, CQ(lambda), designed to accelerate learning by integrating a human operator into the learning process. The CQ(lambda) -learning algorithm enables collaboration of knowledge between the robot and a human; the human, responsible for remotely monitoring the robot, suggests solutions when intervention is required. Based on its learning performance, the robot switches between fully autonomous operation, and the integration of human commands. The CQ(lambda) -learning algorithm was tested on a Motoman UP-6 fixed-arm robot required to empty the contents of a suspicious bag. Experimental results of comparing the CQ(lambda) with the standard Q(lambda), indicated the superiority of the CQ(lambda) while achieving an improvement of 21.25% in the average reward.