Gesture-based programming for robotics: human-augmented software adaptation

Abstract

The paper considers how gesture-based programming systems capture, in real time, the intention behind fleeting, context-dependent hand motions, contact conditions, finger poses, and even cryptic utterances. The systems retain previously acquired skills, which facilitates gesture interpretation during training and provides feedback control at runtime.