← 首页|学术|Tunable Tool-Call Rates in LLM Agents via Representation Steering
cs.AI · 2608.25198 · 2026-08-25

Tunable Tool-Call Rates in LLM Agents via Representation Steering

Yuqi Chen, Vincent Siu, Yang Liu, Dawn Song et al.
工具调用表征编辑推理时控制
💬 用残差流中的单一线性方向就能把工具调用率从接近0%连续调节到90%以上,无需训练、不改prompt,还能泛化到未见过的工具,与duplex场景里"该不该触发某个实时动作"的决策机制高度相通。

🎯 背景

LLM agent决定是否调用工具的能力关乎成本与正确性:多余的调用增加延迟和不可逆副作用,遗漏的调用则让模型在本该借助外部工具的问题上自信地答错。后训练和prompt工程等现有方案代价高,且难以在推理时灵活调整。

🔬 方法

作者证明指令微调模型是否调用工具,可由残差流中一个从模型自身工具偏好信号中抽取、完全不经训练的线性方向控制。用强度α叠加该方向即可把调用率单调地从接近0%推到90%以上,双向可调:调低抑制调用,调高则精准诱发模型自身知识答不出的问题上的调用。该方向对未见工具同样有效,且不偏向特定工具选择。

📊 结果

在真实工具执行下,单次强度扫描即可画出成本/精度的Pareto前沿,开放域QA准确率从0.29提升到0.56;同一方法无需训练即可迁移到dense、MoE、多模态等多种架构的模型上。

原文摘要

▶ Abstract
Deciding whether to call a tool is a core competence of an LLM agent, and a costly one to get wrong: needless calls add latency, accrue cost, and may trigger irreversible side effects, while missing calls leave the model confidently wrong on questions it could only answer through tool-calls. Models manage this balance poorly, both over-using and under-using tools. Existing methods such as post-training and prompt engineering are expensive and difficult to modify at inference time. We show that whether an instruction-tuned model calls a tool can be controlled by a single linear direction in its residual stream, extracted without any training from the model's own tool-use preference signal and turned into an inference-time intervention with no prompt change. Adding the direction with strength $\alpha$ moves the call rate monotonically from near $0\% $ to over $90\%$ while keeping calls well-formed. The steering works in both directions: dialing it down suppresses calls, and dialing it up induces new calls that land precisely on the questions the model cannot answer from its own knowledge. We also show that the direction generalizes to unseen tools with strength comparable to each tool's own direction and without favoring any specific tool choice. With live tool execution, a single sweep of the steering traces a cost/accuracy Pareto frontier and nearly doubles open-domain QA accuracy ($0.29 \! \rightarrow \! 0.56$); the same recipe transfers across a diverse range of models spanning dense, MoE, and multimodal architectures, without any training. Our code is publicly available at this https URL .
来源: arXiv:2608.25198 · 精读由高松灯生成,基于摘要与 arXiv 页面信息