Language understanding

PaLM-E: An Embodied Multimodal Language Model

Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, Wenlong Huang, Yevgen Chebotar, Pierre Sermanet, Daniel Duckworth, Sergey Levine, Vincent Vanhoucke, Karol Hausman, Marc Toussaint, Klaus Greff, Andy Zeng, Igor Mordatch, Pete Florence

Citations: 350 • 2023

TensorFlow: learning functions at scale

Martı́n Abadi

Citations: 336 • 2016

LERF: Language Embedded Radiance Fields

Justin Kerr, Chung Min Kim, Ken Goldberg, Angjoo Kanazawa, Matthew Tancik

Citations: 291 • 2023

Semiotic schemas: A framework for grounding language in action and perception

Deb Roy

Citations: 220 • 2005

TensorFlow: learning functions at scale

Martı́n Abadi

Citations: 141 • 2016

Vision-and-Language Navigation: Interpreting Visually-Grounded Navigation Instructions in Real Environments

Peter Anderson, Qi Wu, Damien Teney, Jake Bruce, Mark Johnson, Niko Sünderhauf, Ian Reid, Stephen Jay Gould, Anton van den Hengel

Citations: 62 • 2018

Grounded Language Learning: Where Robotics and NLP Meet

Cynthia Matuszek

Citations: 34 • 2018

Embodied BERT: A Transformer Model for Embodied, Language-guided Visual\n Task Completion

Alessandro Suglia, Qiaozi Gao, Jesse Thomason, Govind Thattai, Gaurav S. Sukhatme

Citations: 30 • 2021

Language Evolution and Robotics

Paul Vogt

Citations: 29 • 2007

Towards a Dataset for Human Computer Communication via Grounded Language Acquisition

Yonatan Bisk, Daniel Marcu, William Wong

Citations: 24 • 2016

Interactive Planning Using Large Language Models for Partially Observable Robotic Tasks

Lingfeng Sun, Devesh K. Jha, Chiori Hori, Siddarth Jain, Radu Corcodel, Xinghao Zhu, Masayoshi Tomizuka, Diego Romeres

Citations: 23 • 2024

Neural associative memories for the integration of language, vision and action in an autonomous agent

Heiner Markert, Ulrich Kaufmann, Zöhre Kara Kayikci, G. Palm

Citations: 22 • 2009

Multi-modal Discriminative Model for Vision-and-Language Navigation

Haoshuo Huang, Vihan Jain, Harsh Mehta, Jason Baldridge, Eugene Ie

Citations: 21 • 2019

Deep Learning and Sentiment Analysis for Human-Robot Interaction

Mattia Atzeni, Diego Reforgiato Recupero

Citations: 21 • 2018

Iterative Vision-and-Language Navigation

Jacob Krantz, Shurjo Banerjee, Zhu Wang, Jason J. Corso, Peter J. Anderson, Stefan Lee, Jesse Thomason

Citations: 19 • 2023

Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planning

Dhruv Shah, Michael Equi, Błażej Osiński, Fei Xia, Brian Ichter, Sergey Levine

Citations: 14 • 2023

Emergent Multilingual Language Acquisition Using Developmental Networks

Juan Castro-Garcia, Juyang Weng

Citations: 13 • 2019

Combining goal inference and natural-language dialogue for human-robot joint action

Mary Ellen Foster, Manuel Giuliani, Thomas Müller, Alois Knoll, Wolfram Erlhagen, Estela Bicho, Nzoji Hipólito, Luís Louro

Citations: 12 • 2008

SeeWay: Vision-Language Assistive Navigation for the Visually Impaired

Zongming Yang, Liang Yang, Li Ren Kong, Ailin Wei, Jesse Leaman, Johnell O. Brooks, Bing Li

Citations: 12 • 2022

Conversational AI for multi-agent communication in Natural Language

Oliver Lemon

Citations: 12 • 2022