← 首页|学术|FIRE-VLA: Failure-Informed Self-Evolution
cs.RO · 2608.13395 · 2026/08/13

FIRE-VLA: Failure-Informed Self-Evolution for Vision-Language-Action Models in Autonomous Driving

Dou, Hao
TL;DR:把 GRPO 里全组都差、只能排名无法识别失败区域外行为的「未解决失败」转成下一轮的监督:低奖励低多样性组触发从本轮轮初冻结副本自蒸馏。nuScenes 150 场景 6019 例上 G=4 mean L2 1.848→1.500,失败率 13.03→11.20%。

🎯 问题

GRPO 学组内奖励差;当所有采样轨迹都差,相对信号只能给失败排名,无法识别失败区域之外的行为——未解决的失败被浪费。

🔬 方法

FIRE-VLA 失败知情自进化:低奖励低多样性组触发从轮初冻结同参数副本自蒸馏(teacher 只额外看隐藏未来轨迹),监督跟随学生生成前缀、限定 answer token;GRPO 对每组建制始终生效。下轮策略成为新 teacher,路由的失败分布随策略演化,无需更大外部教师。
章节结构(全文标题提取):
1 Introduction
2 Related Work
3 FIRE-VLA
4 Experiments
5 Discussion
6 Conclusion
3.1 Trajectory Learning with Relative Reward · 3.2 Failure-Informed Routing · 3.3 Privileged Future Information · 3.4 On-Policy Answer-Token Distillation · 3.5 Round-Wise Self-Evolution · 4.1 Experimental Setup · 4.2 Main Planning Results · 4.3 Learning from Unresolved Failures · 4.4 Qualitative Analysis

📊 结果

同一 Qwen2.5-VL-3B SFT 起点、rollout 与更新次数完全匹配:单样本规划可比,G=4 mean L2 1.848→1.500m,评估持久失败率 13.03%→11.20%,误差降主要来自罕见严重 rollout 而非均匀改善。

💡 与研究方向关联

与 8/14 的 SHAPER(失败知情自我演化)同主题延续,用户关注的 agentic RL/自演化闭环在 VLA 自动驾驶域落地的实例。

📝 原文摘要

▶ 原文摘要 Abstract
Reinforcement learning improves autonomous-driving vision-language-action (VLA) models by evaluating trajectories sampled from the current policy. Group relative policy optimization (GRPO) learns from reward differences within each rollout group. When all sampled trajectories are poor, this relative signal can rank failures without identifying behavior outside the failed region. We introduce FIRE-VLA, a failure-informed self-evolution framework that converts such unresolved failures into privileged supervision for the next policy. Low-reward, low-diversity groups trigger self-distillation from a frozen round-start copy of the same model. Teacher and student have the same parameter scale, but only the teacher observes the hidden future trajectory. Supervision follows the student's generated prefix and is restricted to answer tokens, while GRPO remains active for every group. The updated policy supplies the teacher for the next round, allowing the routed failure distribution to change with the policy without requiring a larger external teacher. Starting from the same Qwen2.5-VL-3B SFT checkpoint, the comparison matches student rollout and policy-update counts. On 6,019 examples from 150 held-out nuScenes scenes, FIRE-VLA retains comparable single-sample planning, reduces G=4 mean L2 from 1.848 to 1.500 m, and lowers evaluation-persistent failure prevalence from 13.03% to 11.20%. The reduction in mean error arises mainly from rare severe rollouts rather than uniform improvement across ordinary trajectories.
Deep Read · 2026-08-15高松灯 / Agent 日报
VLAGRPOSelf-evolutionAutonomous Driving