LEARNING
VLA模型是否掌握基础知识?衡量视觉-语言-动作模型中的常识与世界知识保持能力
Nikita Kachaev, Andrey Moskalenko, Matvey Skripkin, Nikita Kurlaev, Daria Pugacheva, Albina Burlova, Mikhail Kolosov, Denis Shepelev, Andrey Kuznetsov, Elena Tutubalina, Aleksandr I. Panov, Alexey K. Kovalev, Vlad Shakhuro
- 发表年份
- 2026
- 访问权限
- 开放获取
摘要
该论文提出Act2Answer协议,通过让智能体执行物体放置动作来回答知识问题,从而评估VLA模型在微调后保留的常识和事实知识。大规模实验显示VLA在简单概念上表现良好,但在丰富语义类别上相比源VLM存在较大差距。
关键词
VLAcommonsense knowledgebenchmarkaction-groundedknowledge retention
相关论文
LEARNING
📊 8,465 引用
The Organization of Behavior
D. O. Hebb
2005
LEARNING
📊 7,678 引用
Fractional Brownian Motions, Fractional Noises and Applications
Benoît B. Mandelbrot, John W. Van Ness
1968
LEARNING
开放获取📊 7,484 引用
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
Laith Alzubaidi, Jinglan Zhang, Amjad J. Humaidi 等 10 位作者
2021
LEARNING
📊 4,608 引用
A guide to deep learning in healthcare
Andre Esteva, Alexandre Robicquet, Bharath Ramsundar 等 10 位作者
2018