← 首页|学术|Wrong but Useful: Trajectory Value Beyond Answer Correctness in Multi-Agent Messages
cs.AI, cs.CL, cs.LG · 2608.14375 · 2026/08/14

Wrong but Useful: Trajectory Value Beyond Answer Correctness in Multi-Agent Messages

Yang, Chih-Hsuan, Chowdhury, Anjir Ahmed, Yang, Cheng-Hau, Zheng, Weijian, Llorente, Fernando, Ma, Xiaolong, Li, Xinyang, Huerta, Eliu A., Foster, Ian T., Thakur, Rajeev
TL;DR:「错误但有用」:错误答案常含可用分解/约束/科学原则。DHD 协议缓存五条独立消息、逐一 replay 同一下游 solver,测每条消息的轨迹价值——5 benchmark × 2 模型族全部出现 wrong-helpful 消息,改变最终正确性的错误消息中 >40% 是有益的,可复现效应 p=0.0002。

🎯 问题

多智能体系统按一致/置信/自动评分筛消息决定最终答案,隐含假设「可能正确的消息才值得保留」——错误消息里的有用结构被丢弃。

🔬 方法

Diverse Hypothesis Deliberation:缓存五条独立生成的消息,对同一下游 integrator 逐一 replay(有/无该消息),对比衡量轨迹价值(是否帮助/伤害后续推理)。
章节结构(全文标题提取):
Introduction
Related Work
Method
Experimental Setup
Results
Discussion
Limitations
Conclusion
Acknowledgments

📊 结果

wrong-helpful 消息在每个 benchmark×模型组合都出现;错误答案消息中 4 成以上对最终正确性有益;受控重复证明效应可复现(p=0.0002);完整消息效果最好,保留其推理比只留答案保留更多成功。

💡 与研究方向关联

消息筛选标准的新维度——轨迹价值 vs 答案正确性,对多智能体聚合、deliberation 架构设计有直接意义。

📝 原文摘要

▶ 原文摘要 Abstract
Multi-agent reasoning systems often use agreement, confidence, or automated scores to decide which messages should shape a final answer. Such filtering assumes that a message likely to be correct is also worth keeping. Yet a wrong answer can contain a useful decomposition, constraint, or scientific principle. We test this distinction with Diverse Hypothesis Deliberation (DHD), a controlled measurement protocol that caches five independently generated messages and replays the same downstream solver, called the integrator, with each message available or hidden. The replay comparison measures a message's trajectory value: whether making the message available helps or harms subsequent reasoning. Across five mathematics and science benchmarks and two openly available model families, gpt-oss-120b and gemma-4-31B-it, wrong-helpful messages appear in every benchmark-model combination. Among wrong-answer messages that change final correctness, more than four in ten changes are helpful in each model. Controlled repeats show that the number of repeatable message effects is unlikely to arise from replay variation alone (p=0.0002). A focused intervention on repeatable wrong-helpful messages finds that the complete message works best, while retaining its reasoning preserves more success than retaining only its answer; the source of the complete-message advantage remains open. Within the same problem, repeated trajectory-value evidence also identifies a better keep-or-remove choice than answer correctness alone. Answer correctness is therefore informative but does not determine trajectory value. DHD measures this missing property and produces reusable labels for learning when agents should listen.
Deep Read · 2026-08-18高松灯 / Agent 日报
Multi-AgentTrajectory ValueDeliberationFiltering