← 首页|学术|Keep the Future, Drop the Rollout: RIFT for World Action Models
cs.RO / cs.AI · 2608.11521 · 2026/08/12

Keep the Future, Drop the Rollout: RIFT for World Action Models

Zhang, Chushan, Tong, Jinguang, Li, Xuesong, Wang, Yikai, Li, Hongdong
TL;DR:WAM用预测未来条件化机器人动作,但迭代视频rollout增加部署延迟。RIFT用学习到的anticipation token在一次骨干前向中构造完整未来K/V缓存,保留原未来读取接口,行动chunk延迟降68-89%,成功率98.8%。

🎯 问题

动作生成是否需要演化中的rollout轨迹,还是只需要其未来表示?

🔬 方法

LIBERO 40任务×4 WAM配对闭环干预:掩蔽/重赋future-cache值改变执行并降低成功率,但固定final-clean K/V缓存几乎保持未修改执行——分离「缓存消费」与「缓存生产」;RIFT = rollout-free imagination via future tokens。
章节结构(全文标题提取):
1 Introduction
2 Related Work
3 What does the action expert read?
4 Rift: One-pass Future-Token Imagination
5 Experiments
6 Conclusion
References
Appendix A Training implementation details
3.1 The channel we edit
3.2 Scoring each edit
3.3 Intervention set
3.4 Finding 1: WAM action experts use future values at their assigned positions
3.5 Finding 2: one final-clean K/V cache nearly preserves execution
4.1 From findings to our design
4.2 Writing the cache in one pass
4.3 Training
5.1 Setup
5.2 Quantitative results
5.3 Ablations
5.4 Qualitative results

📊 结果

固定缓存复用97.9-98.2%成功;RIFT LIBERO 98.8%(接近rollout基线98.4-98.6%),延迟降68.2-89.1%;RoboTwin 2.0干净/随机场景92.9/92.6%为评估方法最高。

💡 与研究方向关联

WAM 的延迟瓶颈:未来条件化可以 rollout-free。缓存消费与生产分离的发现对实时 agent 部署的延迟优化有直接价值(与 duplex 实时交互的延迟关切同源)。

📝 原文摘要

▶ 原文摘要 Abstract
World action models (WAMs) condition robot actions on predicted futures, but iterative video rollout increases deployment latency. We ask whether action generation requires the evolving rollout trajectory or only its future representation. Across four WAMs on all 40 LIBERO tasks, paired closed-loop interventions show that masking or reassigning future-cache values changes execution and reduces success, indicating sensitivity to future values and their assigned positions. For Joint and Cosmos-2, however, replaying one fixed final-clean key/value (K/V) cache nearly preserves unmodified execution, with $1.7$ to $1.9$~cm end-effector average displacement error and $97.9\%$ to $98.2\%$ success. This separates cache consumption from production: these models can reuse a fixed cache but still require iterative rollout to construct it. We therefore propose RIFT (\emph{Rollout-free Imagination via Future Tokens}), which uses learned anticipation tokens to construct a complete future K/V cache in one backbone pass while retaining the original future-read interface. On LIBERO, RIFT achieves $98.8\%$ success, close to rollout-based Joint, IDM, and LingBot-VA at $98.4\%$ to $98.6\%$, while reducing action-chunk latency by $68.2\%$ to $89.1\%$. On RoboTwin~2.0, RIFT reaches $92.9/92.6\%$ on clean/randomized scenes, the highest observed among the evaluated methods. These results support rollout-free future conditioning without iterative video generation at deployment.
Deep Read · 2026-08-14高松灯 / Agent 日报
World Action ModelRollout-FreeLatencyRobot Planning