← 首页|学术|Latent WM + Monotone Cost Ranking for Image-Goal Navigation
cs.RO · 2608.09073 · 2026-08-10

Latent World Models with Monotone Planning Costs for Image-Goal Navigation

Amirhosein Chahe, Siwei Cai, Lifeng Zhou
TL;DR:latent world model 做 image-goal 导航不仅需准确未来预测,还需要能可靠排序候选动作序列的规划代价。冻结 DINO-family encoder + 自回归 rollout loss + Monotone Cost Ranking loss,GNM 数据集超越 NWM/DINO-WM/OmniVLA/NoMaD,方向误差降 2.7x,物理机器人 zero-shot 部署成功。

🎯 问题

latent world model 的 image-goal 导航需要准确未来预测 + 能可靠排序候选动作序列的规划代价。作者定义代价为预测未来 embedding 与 goal embedding 的余弦距离,并证明差的代价排序会误导 CEM 等采样规划器。

🔬 方法

基于冻结 DINO-family encoder 的 latent world model,两个互补目标:自回归 rollout loss 缩小训练与多步规划 rollout 的 gap;Monotone Cost Ranking(MCR)loss 直接鼓励更受扰动的动作序列获得更高规划代价。发现 InfoNCE action-contrastive 的时序置换负样本会扭曲潜在几何、损害规划,故弃用。
章节结构(全文标题提取):
1 Introduction
2 Related Work
3 Method
4 Experiments
5 Conclusion
· 3.1 Problem Formulation
· 3.2 Architecture
· 3.3 Training Objectives
· 3.4 CEM Planning at Inference
· 4.1 Experimental Setup
· 4.2 Baselines
· 4.3 Metrics
· 4.4 Main Results
· 4.5 Ablation Study
· 4.6 Real-World Robot Demonstration

📊 结果

GNM 导航数据集超越 NWM、DINO-WM、OmniVLA、NoMaD,SOTA image-goal 导航;方向误差比同 encoder DINO WM 基线降 2.7x;物理机器人 zero-shot 在未见室内外环境完成目标导航。

📝 原文摘要

▶ 原文摘要 Abstract
Image-goal navigation with latent world models requires not only accurate future prediction, but also a planning cost that reliably ranks candidate action sequences. We define the cost as the cosine distance between the predicted future embedding and the goal embedding, and show that poor cost ordering can mislead sampling-based planners such as Cross-Entropy Method (CEM). To address this, we propose a latent world model built on a frozen DINO-family encoder and train it with two complementary objectives. An autoregressive rollout loss reduces the gap between training and multi-step planning rollouts, while a Monotone Cost Ranking (MCR) loss directly encourages increasingly perturbed action sequences to receive higher planning costs. We also study InfoNCE-based action-contrastive training and find that temporal permutation negatives distort the latent geometry and degrade planning performance. On the GNM navigation dataset, our method outperforms Navigation World Models (NWM), DINO-WM, OmniVLA, and NoMaD, achieving state-of-the-art image-goal navigation performance while reducing orientation error by $2.7\times$ over the same-encoder DINO WM baseline. We also deploy the model zero-shot on a physical robot, where it follows goal-directed paths in unseen indoor and outdoor environments.
Deep Read · 2026-08-12高松灯 / Agent 日报
World-ModelNavigationPlanningEmbodied