Multimodal learning

Learning Object Affordances: From Sensory--Motor Coordination to Imitation

Luis Montesano, Manuel Lopes, Alexandre Bernardino, José Santos-Victor

引用数: 354 • 2008

Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language

Andy Zeng, Krzysztof Choromański, Adrian Wong, Stefan Welker, Federico Tombari, Aveek Purohit, Michael S. Ryoo, Vikas Sindhwani, Johnny Lee, Vincent Vanhoucke, Pete Florence

引用数: 171 • 2022

Emotion recognition from unimodal to multimodal analysis: A review

Kaouther Ezzameli, Hela Mahersia

引用数: 169 • 2023

Multimodal Human–Robot Interaction for Human‐Centric Smart Manufacturing: A Survey

Tian Wang, Pai Zheng, Shufei Li, Lihui Wang

引用数: 151 • 2023

Multimodal human action recognition in assistive human-robot interaction

Isidoros Rodomagoulakis, Nikolaos Kardaris, Vassilis Pitsikalis, Effrosyni Mavroudi, Athanasios Katsamanis, Antigoni Tsiami, Petros Maragos

引用数: 118 • 2016

Deep unsupervised network for multimodal perception, representation and classification

Alain Droniou, Serena Ivaldi, Olivier Sigaud

引用数: 63 • 2014

Fusion of tactile and visual information in deep learning models for object recognition

Reza Pebdani Babadian, Karim Faez, Mahmood Amiri, Egidio Falotico

引用数: 61 • 2022

Attention via Synchrony: Making Use of Multimodal Cues in Social Learning

Matthias Rolf, Marc Hanheide, Katharina J. Rohlfing

引用数: 52 • 2009

Tutorial on Multimodal Machine Learning: Principles, Challenges, and Open Questions

Paul Pu Liang, Louis‐Philippe Morency

引用数: 46 • 2023

Enhancing EFL vocabulary learning with multimodal cues supported by an educational robot and an IoT-Based 3D book

Vivien Lin, Hui‐Chin Yeh, Huai‐Hsuan Huang, Nian‐Shing Chen

引用数: 44 • 2021

Towards multimodal neural robot learning

Stefan Wermter, Cornelius Weber, Mark Elshaw, Christo Panchev, Harry Erwin, Friedemann Pulvermüller

引用数: 40 • 2004

Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions

Paul Pu Liang, Amir Zadeh, Louis‐Philippe Morency

引用数: 36 • 2022

Online Multimodal Ensemble Learning Using Self-Learned Sensorimotor Representations

Martina Zambelli, Yiannis Demiris

引用数: 35 • 2016

Multimodal Signal Processing and Learning Aspects of Human-Robot Interaction for an Assistive Bathing Robot

Athanasia Zlatintsi, Isidoros Rodomagoulakis, Petros Koutras, Αθανάσιος Δομέτιος, Vassilis Pitsikalis, Costas S. Tzafestas, Petros Maragos

引用数: 24 • 2018

MultiBench: Multiscale Benchmarks for Multimodal Representation Learning

Paul Pu Liang, Yiwei Lyu, Xiang Fan, Zetian Wu, Yun Cheng, Jason Wu, Leslie Chen, Peter Wu, Michelle A. Lee, Yuke Zhu, Ruslan Salakhutdinov, Louis‐Philippe Morency

引用数: 22 • 2021

Emotion recognition models for companion robots

Ritvik Nimmagadda, Kritika Arora, Miguel Vargas Martín

引用数: 22 • 2022

Improving Unimodal Object Recognition with Multimodal Contrastive Learning

Johannes Meyer, Andreas Eitel, Thomas Brox, Wolfram Burgard

引用数: 21 • 2020

Multimodal Representation Learning for Place Recognition Using Deep Hebbian Predictive Coding

Martin J. Pearson, Shirin Dora, Oliver Struckmeier, Thomas C. Knowles, Ben Mitchinson, Kshitij Tiwari, Ville Kyrki, Sander M. Bohté, Cyriel M. A. Pennartz

引用数: 21 • 2021

Associate Latent Encodings in Learning from Demonstrations

Hang Yin, Francisco S. Melo, Aude Billard, Ana Paiva

引用数: 20 • 2017

Privileged Knowledge Distillation for Dimensional Emotion Recognition in the Wild

Muhammad Haseeb Aslam, Muhammad Zeeshan, Marco Pedersoli, Alessandro L. Koerich, Simon Bacon, Éric Granger

引用数: 20 • 2023