← 首页|学术|ContactGuard: Pre-Contact Execution Monitoring
cs.RO · cs.AI · cs.CV · 2608.13438 · 2026/08/13

ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models

Zheng, Gehan, Johnson-Roberson, Matthew, Zhi, Weiming
TL;DR:给腕部相机的分块 visuomotor 策略加「接触前执行监控」:用动作条件化隐世界模型预测动作块短期后果,预测到失败就在接触前中止。真实接触密集操作任务上比直接/扰动消融更准,且无需改底层策略。

🎯 问题

接触密集操作失败常到机器人已commit 接触才发现;腕部相机下接近不良可能在传统检测器反应前已推/漏/滑/扰动物体。

🔬 方法

ContactGuard:给定策略计划的动作块,在隐视觉空间预测短期后果,预测隐态预示失败就中止。隐世界模型从无标注机器人轨迹学习预测多视角视觉 embedding(不做像素级视频预测);轻量失败探针从少量标注的接触前片段训练。部署时在即将接触事件前锚定预测,在策略自身动作下滚动,验证预测的接触后隐态。
章节结构(全文标题提取):
1 Introduction
2 Related Work
3 Latent World Models for Pre-Contact Grasp Monitoring
4 Experimental Results
5 Conclusions, Limitations, and Future Work
3.1 Problem Setting and Data · 3.2 Background: LeWM-style Latent Prediction · 3.3 Multi-View Latent World Model · 3.4 Linear Failure Probe on Predicted Latents · 3.5 Online Pre-Contact Grasp Monitor · 4.1 Experimental Setup · 4.2 Closed-Loop Grasp-Outcome Prediction · 4.3 Offline Diagnostics: What Information Does the Monitor Use?

📊 结果

真实接触密集操作上失败预测比 direct/扰动消融更准;作为接触前中止信号迁移到真机,不修改底层策略。

💡 与研究方向关联

「在事态 commit 前预测后果」正是执行安全的形态,与用户对 agent 可靠执行的关注一致,也是世界模型从生成走向监控的实际应用。

📝 原文摘要

▶ 原文摘要 Abstract
Contact-rich manipulation failures are often detected only after the robot has committed to contact. This is especially limiting in wrist-camera setups: close gripper--object views help observe contact, but a poor approach may already push, miss, slip, or disturb the object before conventional detectors react. We introduce \emph{ContactGuard}, a pre-contact execution monitor for chunked visuomotor policies. Given the policy's planned action chunk, ContactGuard predicts its short-horizon consequence in latent visual space and aborts if the predicted future latent indicates likely failure. Its latent world model is trained from unlabelled robot trajectories to predict compact multi-view visual embeddings under planned actions, avoiding pixel-level video prediction. A lightweight failure probe is then trained from a small labelled set of pre-contact clips. At deployment, ContactGuard anchors prediction before an imminent contact event, rolls the model forward under the policy's own actions, and verifies the predicted post-contact latent. Across real-world contact-rich manipulation tasks, ContactGuard predicts failure more accurately than direct and corrupted-action ablations, and transfers to live robot as a pre-contact abort signal without modifying the underlying policy.
Deep Read · 2026-08-15高松灯 / Agent 日报
World ModelRobot ManipulationExecution MonitorSafety