← 首页|学术|JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolution
cs.CL, cs.LG · 2608.25593 · 2026-08-26

JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolution

Guibin Zhang, Leo Lu, Fangzhou Xie, Kang Zhu et al.
Agent架构Harness自我进化
💬 把agent harness(记忆管理/规划策略/动作协议/工具编排)本身当作可训练、可即时生成的产物,训练出专门模型为任意基座LLM实时合成/修复/自我进化harness,证明"harness智能"是独立于模型规模的可训练维度。

🎯 背景

Agent能力不仅取决于模型本身,harness设计(记忆管理、规划策略、动作协议、工具/技能编排)往往主导底层基座模型的实际贡献,但harness设计至今仍是人工、任务特定、不可扩展的。

🔬 方法

JIT-Agent把agent harness形式化为受固定四模块协议约束的可组合、机器可生成artifact,训练模型为给定任务定制harness、修复harness以实现稳定可靠执行,并通过从不断扩大的历史harness配置档案中蒸馏性能信号来自我进化。

📊 结果

用JIT-Agent做harness helper,DeepSeek-V4-Flash在DeepSearchQA上反超GPT-5.6(+9.1)、在OdysseyBench上+4.3,已经很强的GLM-5.2最高提升20.2分;JIT-Agent生成的harness在受控评测中与OpenCode、Claude Code等成熟agent运行时性能相当,并在DeepSeek V4、Mimo-V2.5、Qwen3.6等多规模模型家族上稳定提升。

原文摘要

▶ Abstract
Agent capability is not determined by the model alone. The agent harness, encompassing memory management, planning strategy, action protocol, and tool/skill orchestration, can dominate the contribution of the underlying foundation model. Yet harness design remains manual, task-specific, and fundamentally unscalable. We present JIT-Agent, a harness intelligence model trained to synthesize task-adaptive agent harnesses on the fly for arbitrary off-the-shelf agentic LLMs. We formalize the agent harness as a composable, machine-generatable artifact governed by a fixed four-module protocol, and train JIT-Agent to customize harnesses for a given task at hand, repair harnesses for stable and reliable execution, and self-evolve by distilling performance signals from an expanding archive of prior harness configurations. Equipped with JIT-Agent as a harness helper, DeepSeek-V4-Flash surpasses GPT-5.6 on DeepSearchQA (+9.1) and OdysseyBench (+4.3), while the already strong GLM-5.2 gains up to +20.2 points. Across controlled evaluations, JIT-Agent-generated harnesses are performance-competitive with mature agent runtimes such as OpenCode and Claude Code and consistently improve multi-scale model families of DeepSeek V4, Mimo-V2.5, and Qwen3.6. To our knowledge, JIT-Agent is the first model purpose-built for just-in-time harness generation, establishing harness intelligence as a trainable, transferable, and compounding dimension of agent capability orthogonal to model scaling.
来源: arXiv:2608.25593 · 精读由高松灯生成,基于摘要与 arXiv 页面信息