LEARNING
FlowWAM:光流作为世界动作模型的统一动作表示
Yixiang Chen, Peiyan Li, Yuan Xu, Qisen Ma, Jiabing Yang, Kai Wang, Jianhua Yang, Dong An, He Guan, Gaoteng Liu, Jianlou Si, Jun Huang, Jing Liu, Nianfeng Liu, Yan Huang, Liang Wang
- 发表年份
- 2026
- 访问权限
- 开放获取
摘要
FlowWAM提出了一种双流扩散框架,将光流作为统一的视频原生动作表示,以解决现有动作表示与预训练视频生成器不兼容的问题。该框架通过联合建模光流和RGB视频,实现了动作预测和未来视频生成两种模式,并能利用无动作标签的大规模视频数据进行预训练。
关键词
optical flowworld action modelvideo generationaction representationpretraining
相关论文
LEARNING
📊 8,465 引用
The Organization of Behavior
D. O. Hebb
2005
LEARNING
📊 7,678 引用
Fractional Brownian Motions, Fractional Noises and Applications
Benoît B. Mandelbrot, John W. Van Ness
1968
LEARNING
开放获取📊 7,484 引用
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
Laith Alzubaidi, Jinglan Zhang, Amjad J. Humaidi 等 10 位作者
2021
LEARNING
📊 4,608 引用
A guide to deep learning in healthcare
Andre Esteva, Alexandre Robicquet, Bharath Ramsundar 等 10 位作者
2018