← 首页|学术|The Objective Is the Bottleneck
cs.LG · cs.AI · 2608.12959 · 2026/08/13

The Objective Is the Bottleneck: Latent World Models Encode What Their Planners Cannot Use

Singh, Joyjeet
TL;DR:诊断 LatentWorldModel 长程规划失败:瓶颈不是预测器而是 planner 目标。CEM 最小化平方隐距离,该距离与真实距离只相关 r=0.426 且 80 单位后饱和、120 后下降——远离目标反而能降 cost。只换目标函数(零重训零 GPU),offset-100 目标达成率 26.0% → 98.0%。

🎯 问题

隐世界模型按预测能力评判,长程规划失败通常归咎于预测器退化。但 LatentWorldModel 在 TwoRoom 复现上,真实瓶颈是 planner 的目标函数而非预测器。

🔬 方法

核心洞察:cross-entropy-method 规划最小化平方隐距离,而隐距离与真实距离相关仅 r=0.426、约 80 竞技场单位饱和、超 120 后下降——远离目标可能降低 cost。ridge probe 从冻结 embedding 恢复位置 R²=0.9922,信息一直都在,病根在方法。跨四个 checkpoint 长程成功与指标质量序一致、与预测精度反序。
章节结构(全文标题提取):
1 Introduction
2 Setup
3 The predictor is not the bottleneck
4 The objective saturates, then inverts
5 The pathology is the method’s, and it explains the dissociation
6 The information is present
7 Repair
8 Results
9 Limitations
10 Related work
11 Conclusion
References
Contributions · Scope · 4.1 This is the observed failure · 5.1 The authors’ own weights · 5.2 Metric quality orders long-horizon planning · 5.3 A correlate, not a cause · 7.3 The better objective is the less accurate one · 7.4 A learned cost must be trained on what the planner scores · 8.1 Planning becomes horizon-independent · 8.2 Where the learned cost loses, and why

📊 结果

只替换目标函数、零重训零 GPU:offset-100 目标达成 26.0% → 98.0%,等于 offset-25 的 98.0%,三分一预算下 92.0%——规划不再依赖视野长度。最佳 cost 不是最准 cost。

💡 与研究方向关联

「规划目标与预测表征失配」是 latent-space planning 的系统性陷阱,对世界模型驱动 agent 有普遍警示——与 ACPC 诊断线互补。

📝 原文摘要

▶ 原文摘要 Abstract
Latent world models are judged by how well they predict, so when planning fails at long horizons the natural reading is that the predictor degrades. On a reproduction of LeWorldModel on TwoRoom we show the binding constraint is the planner's objective instead. The predictor is not the limit: its imagined state seventy-five environment steps ahead is still only 0.189 as wrong as assuming the world froze, while the planner never imagines beyond twenty-five. The objective is. Cross-entropy-method planning minimises squared latent distance, which tracks true distance at r = 0.426, saturates by about eighty arena units and decreases beyond a hundred and twenty, so moving away from the goal can lower the cost. The information is present throughout: a ridge probe recovers position from the frozen embedding at R^2 0.9922. The pathology is the method's, not one reimplementation's. It is present in the authors' released weights, and across four checkpoints long-horizon success rank-orders exactly with metric quality and inversely with prediction accuracy. Replacing only the objective, with nothing retrained and no GPU, lifts goals reached at offset 100 from 26.0% to 98.0%, equals the 98.0% at offset 25, and reaches 92.0% under a third of the budget: planning stops depending on the horizon. The best cost is not the most accurate. A head learned from frame separation alone predicts spatial distance worse than a position probe (r = 0.819 against 0.9897) yet plans better, charging 24% more to cross the environment's dividing wall where squared latent distance charges 4% less. It has learned reachability, not proximity.
Deep Read · 2026-08-15高松灯 / Agent 日报
World ModelPlanningCEMLatent Space