Learning Under-Specified Object Manipulations from Human Demonstrations

Abstract

Learning by Demonstration (LbD) allows robots to acquire manipulation skills through human demonstration. In this regard, it is a challenging task to perceive spatial-temporal relations between sub-activities and object affordance in human demonstrations, especially when they are under-specified. This work extends the Probability Graph Model based methods to incorporate high-level demonstration classification. We propose an approach to model the semantics of human demonstration using Programming Domain Description Language (PDDL). Therefore, hidden motion primitives that are impossible to be learned directly from observing human demonstration in noisy video data can be inferred and the robot's plans are refined. Experimental results validate the effectiveness of the proposed method, in which more refined scripts can be generated for robot's execution.