← 首页|学术|Second Thought: Reasoning in Parallel as LLM Agents Act and Observe
cs.AI, cs.SE · 2608.13667 · 2026/08/13

Second Thought: Reasoning in Parallel as LLM Agents Act and Observe

Sun, Zhensu, Yang, Chengran, Lyu, Yunbo, Shi, Jieke, Lo, David
TL;DR:把 ReAct 的「行动+等待观测」识别为推理空闲窗口,fork 四个辅助分支与主循环并行解码、观测返回时合并,把附加推理移出主线程串行路径——turn 数 9/9 全降,主线程解码最多降 43% 且 Pass@1 不损。

🎯 问题

ReAct agent 的深思推理被锁死在 Thought 阶段:动作发出、等待环境观测的整个间隔里推理冻结,这串行解码时段是浪费的空闲窗口。

🔬 方法

Second Thought:training-free 推理框架。每个 Thought 阶段结束瞬间 fork 四条辅助分支与主循环并发解码,环境观测到达时把生成的思考合并回主线程。核心是把新增推理从主线程串行路径上搬走。附计算匹配对照(等量算力压到主线程自身推理)。
章节结构(全文标题提取):
Introduction
Related Work
Method
Experiments
Conclusion

📊 结果

三个 agentic benchmark × 三个推理 LLM:平均 turn 数 9/9 全降;主线程解码 6/9 降最多 43%(平均约 20%),1/9 基本不变;Pass@1 7/9 无显著变化,两个显著差为 +12.4/+10.2。对计算匹配对照,用 1.3-3.2 倍更少的串行解码取得严格更高的 Pass@1。

💡 与研究方向关联

「利用等待时间做并行推理」与用户核心方向 duplex 的解耦哲学同构——互动层在外、思考层在里,把深思推理从交互的串行路径上挪开。是今日最贴近 duplex 架构思想的论文。

📝 原文摘要

▶ 原文摘要 Abstract
LLM agents in the ReAct paradigm alternate between reasoning, acting, and observing, but deliberate reasoning is confined to the Thought phase: while the agent serializes an action and waits for the environment, its reasoning is frozen. We identify this recurring interval for Action and Observation as a reasoning idle window and ask whether it can host additional reasoning in parallel that serves future turns. Therefore, we propose Second Thought, a training-free inference framework that forks four auxiliary branches the instant each Thought phase concludes, decodes them concurrently with the main loop, and merges the generated thoughts back when the environment observation arrives. In this way, Second Thought relocates the added reasoning off the main thread's sequential decoding path. Across three agentic benchmarks and three reasoning LLMs, Second Thought lowers the average turn count in all nine (model,benchmark) pairs and reduces main thread decoding in six of them by up to 43% (roughly 20% on average among those settings), while leaving it essentially unchanged in a seventh; Pass@1 shows no significant change in seven of nine pairs and the two significant differences are +12.4 and +10.2 points. Against a compute-matched control that forces an equivalent budget onto the main thread's own reasoning, it attains strictly higher Pass@1 with 1.3 to 3.2 less sequential decoding in all four settings where the control applies.
Deep Read · 2026-08-18高松灯 / Agent 日报
Parallel ReasoningReActLatencyAgent Inference