Robot learns realistic lip sync by watching itself and online videos

Summary

Columbia Engineering researchers developed a robot that autonomously learns realistic lip movements for speech and singing by observing its own reflection and human videos, without explicit programming. This self-supervised learning approach significantly reduces the uncanny valley effect in human-robot interaction.