← 首页|学术|ACE Lens: Unifying Agentic Data Generation
cs.AI, cs.CL · 2608.27260 · 2026-08-27

What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents

Xingshan Zeng, Zishan Xu, Boju Zhang, Yuzhou Wu, Lingzhi Wang, Jianghao Lin, Liangyou Li, Yasheng Wang, Lifeng Shang, Xin Jiang, Weinan Zhang, Yong Yu, Qun Liu, Weiwen Liu
Agentic Data训练方法论LLM Agent
💬 把「agentic data 生成」统一成 (E,q,τ,v) 四元组,用 Accuracy-Complexity-divErsity 三轴透镜梳理整条领域文献。

🎯 背景

Agent 训练越来越依赖生成的交互数据,但不同领域各自为战:候选构造、验证、筛选三个环节经常被混为一谈,导致「造了多少数据」和「数据到底有没有用」两件事分不清。

🔬 方法

提出统一的因子化表示 (E,q,τ,v)——环境规范、任务信号、交互实现、可选验证器;再用 ACE 透镜(Accuracy 可行域、Complexity 相对学习者能力的难度配置、divErsity 覆盖/去冗余)重新组织生成范式。

📊 结果与意义

综述发现领域正从「表面正确」转向「执行落地的正确性」、从「绝对难度」转向「相对学习者的难度」、从「数据量堆砌」转向「行为覆盖多样性」——这对 duplex agent 这类需要大量真实交互轨迹训练的场景,是很直接的数据构造方法论参考。
▶ 原文摘要 Abstract
LLM agents increasingly rely on generated interaction data to learn how to interact with external environments. Agentic data generation must maintain consistency among environments, tasks, interactions, and success signals while producing experience that is useful rather than merely abundant. Existing work spans many agent domains, but domain-centered organization and heterogeneous evaluation often obscure common generation mechanisms and conflate candidate construction with verification and selection. This work develops a two-level framework for the field. First, we represent agentic data as a common factorized object $(E,q,\tau,v)$, comprising an environment specification, task signal, interaction realization, and optional verifier. We organize generation paradigms by their primary anchor and dependency structure. Second, we formulate generation as constrained distribution design through the Accuracy-Complexity-divErsity (ACE) lens. Accuracy establishes the feasible support of grounded and internally consistent data. Within this support, Complexity places learning mass relative to the capability of a declared learner and execution configuration, while divErsity controls coverage and redundancy of data. Using this framework, we explore how prior work verifies generated experience, constructs and calibrates difficulty, and expands behavioral coverage. The literature reveals a shift toward execution-grounded accuracy, learner-relative complexity, and diversity beyond surface variation or dataset size. We further discuss broader directions and emerging trends in agentic data generation through the ACE lens, including their implications for scaling, data sources, training regimes and adaptive learning. Overall, the central challenge is not simply to generate more data, but to continually allocate valid, informative, and non-redundant experience as agents and environments evolve.
来源:arXiv:2608.27260 · 精读基于摘要与 arXiv HTML/abs 页信息生成,未解析 PDF 全文