← 首页|学术|The Handoff Tax: Continuing Non-Native Trajectories in LLM Agents
cs.AI · 2608.24358 · 2026-08-25

The Handoff Tax: Continuing Non-Native Trajectories in LLM Agents

Roy Ganz, Mor Shpigel Nacson, Adi Kalyanpur, Ron Litman
Coding AgentsModel CascadesCost-Quality Tradeoff
💬 编码 agent 在模型间升级/降级切换时要付出"交接税":全轨迹升级恢复不到一半的能力差距、成本却大涨;降级则是更划算的选择;有意思的是,减少信息量在升级和降级两个方向上的效果正好相反。

🎯 背景

编码 agent 执行跨越数十次模型调用、工具使用和代码编辑的长程任务。随着运行展开,用户面临实际的成本-质量权衡:在便宜模型遇到困难时升级到更强模型,或者在困难推理完成后降级回便宜模型。每一次模型切换,都要求接收方模型继续一段由另一个模型产生的"非原生轨迹"。

🔬 方法

论文用 Claude 和 GPT 家族中低成本低能力(LC)与高成本高能力(HC)模型配对,系统研究这种交接如何影响质量和成本,以及改变接收方继承的轨迹信息量会如何改变结果。作者在保留仓库状态的前提下,比较全轨迹迁移、压缩、和完全移除轨迹三种交接方式,并变化交接的方向、时机和接口形式。

📊 结果

在两个模型家族上,全轨迹升级恢复的 LC→HC 质量差距不到一半,同时产生显著的成本溢价——作者将这种成本-质量代价命名为"交接税"(handoff tax)。相比之下,降级提供了更有利的成本-质量位置。有意思的是,最优接口的选择也会随交接方向反转:升级时减少 LC 模型的轨迹信息反而能提升质量,而降级时移除 HC 模型的轨迹却会降低质量。

原文摘要

▶ Abstract
Coding agents perform long-running tasks spanning dozens of model calls, tool uses, and code edits. As these runs unfold, users face a practical cost-quality trade-off: escalating to a stronger model when a cheaper one struggles, or downshifting once the hard reasoning is complete. Each switch requires the receiver to continue a non-native trajectory produced by another model. We study how this handoff affects quality and cost, and how varying the trajectory information inherited by the receiver changes the outcome. Using pairs of low-cost, low-capability (LC) and high-cost, high-capability (HC) models from the Claude and GPT families, we vary handoff direction, timing, and interface, comparing full-trajectory transfer, compaction, and trajectory removal while preserving the repository state. Across both model families, full-trajectory escalation recovers less than half of the LC-to-HC quality gap while incurring a substantial cost premium. We term this cost-quality penalty the handoff tax. By contrast, downshift offers a favorable cost-quality point. Interestingly, the preferred interface also reverses with direction: reducing LC-model trajectory information improves escalation quality, whereas removing the HC-model trajectory reduces downshift quality.
来源: arXiv:2608.24358 · 精读由高松灯生成,基于摘要与 arXiv 页面信息