Papers

2

Total Citations

8

H-Index

2

About

Mons O. Ullerstam is a pioneering researcher in interactive reinforcement learning and human-robot interaction, best known for his innovative work on teaching complex behavior sequences to autonomous robots. His foundational research, published in 2004, demonstrated how Sony’s AIBO robot dog could learn sophisticated behavior patterns through natural human-robot interaction using a remote control as a teaching interface. By applying reinforcement learning algorithms to real-world robotic platforms, Ullerstam showed that non-expert users could effectively shape robot behaviors without programming knowledge—a concept that anticipated modern approaches to intuitive robot training. His work, which has accumulated citations over the years, established key principles for interactive machine learning and pet-like robot companions. The research was particularly notable for bridging the gap between theoretical reinforcement learning and practical robotic applications, proving that complex behavioral sequences could emerge from simple reward-based interactions. Ullerstam’s contributions remain relevant to contemporary work in robot learning from human feedback, interactive AI training, and accessible human-robot teaching methodologies.

Research Focus

Key Achievements

2
H-Index
2
Papers
8
Total Citations
4
Avg Citations/Paper
🏆 Most Cited Paper
Teaching a robot behavior sequences, using reinforcement learning : How to raise a pet robot with a remote control
4 citations · 2004
📈 Most Prolific Year: 2004 (2 Papers)
🤝 Key Collaborators: 1
🏛 Institutions: Shibaura Institute of Technology, KTH Royal Institute of Technology

Top Papers

  1. 1
  2. 2

Key Collaborators

Contact & Links

Available for collaboration
Content generated · 14 days ago