James Pustejovsky

Papers

Total Citations

H-Index

About

James Pustejovsky is a pioneering figure in computational linguistics and multimodal semantics, whose work bridges language, vision, and human-robot interaction. His research centers on how meaning emerges across multiple modalities—speech, gesture, and spatial context—and how computational agents can interpret and act upon these rich signals. Pustejovsky’s major contributions include defining the theoretical foundations of multimodal spatial role labeling, as demonstrated in his CLEF 2017 task overview (21 citations), which established benchmarks for grounding spatial language in visual scenes. He has also advanced ethical frameworks for language-capable robots, exploring the societal implications of autonomous systems that communicate naturally (9 citations). His work on multimodal semantics for affordances and actions (8 citations) and continuation-style architectures for human-robot interaction (6 citations) has shaped how robots integrate real-time gesture and speech into contextual models. Pustejovsky’s impact is evident in his foundational role in the field, with over 20,000 total citations across his career, and his leadership in developing the Generative Lexicon theory, a cornerstone of lexical semantics. His research continues to inspire students and researchers working at the intersection of AI, linguistics, and robotics.