ArXiv · 2026-08-13
Agent 日报
今日 270 篇候选 · 精选 16 篇 · 批量精读模式
🎙️ 全双工 / 语音交互
cs.CL / eess.AS · 2608.10878 · 2026/08/11
在流式 ASR 上并行加一个 frame-synchronous 轮转状态头,让语音助手以帧级粒度实时区分「打断 / 应忽略的 backchannel / 语轮完成」。中英双语 Easy-Turn 测试集上低延迟高准确率。
▶ 原文摘要 Abstract
Accurate and responsive turn-taking is essential for spoken dialogue systems, which must distinguish in real time between user interruptions, backchannels that should be ignored, and the completion of an utterance. Prior modular approaches typically optimize turn state prediction at the utterance or fixed-chunk level, creating a mismatch with the continuous turn state estimate, and often depend on an auxiliary ASR model, which limits responsiveness and increases overall system complexity. Therefore, we present X2-Turn, a frame-synchronous turn state prediction method via delayed-stream modeling. Specifically, building on the pretrained Voxtral Realtime model, we introduce a frame-synchronous turn state head that operates in parallel with the ASR head on shared streaming representations, jointly predicting ASR tokens and fine-grained turn states at the frame level. We evaluate our method on the bilingual Chinese-English Easy-Turn test sets, and the results demonstrate its effectiveness in achieving accurate turn-taking detection while maintaining low latency.
Fu, Kaiqi, Wen, Rime, Lin, Altman, Qin, Shawn, Gan, Roy, Wang, Hao
DuplexTurn-TakingStreaming ASRSpeech
cs.AI / cs.CL / cs.CV · 2608.10720 · 2026/08/11
全模态对话模型生成「文本 + 个性化语音 + 参考条件视频」的协调响应:Visual Thought Plan 描述场景/情绪/动作,语音单元作为共享声学-时间接口与视频帧在线对齐,蒸馏出 Streaming Student 实现 RTF=1.293 的低延迟增量生成。
▶ 原文摘要 Abstract
Omni-modal dialogue models can understand multimodal inputs and synthesize spoken replies, yet their responses remain visually disembodied. We introduce \textbf{Ex-Omni-2D}, an omni-modal dialogue framework that generates a coordinated response comprising text, personalized speech, and reference-conditioned video. Given a multimodal query, reference image, and reference audio, the model predicts a structured \textit{Visual Thought Plan} (VTP) describing scene, emotion, and motion, followed by response text and native multi-codebook speech units. These units form a shared acoustic-temporal interface: they are decoded into speech and aligned online with video frames. This interface enables the response and avatar pathways to be learned from heterogeneous speech, dialogue, and avatar-video data, avoiding the need for large-scale query--text--speech--video supervision. A full-sequence Video Generator serves as the primary Teacher. For efficient incremental generation, we further distill it into a few-step block-causal \emph{Streaming Student} whose Prefix Streaming mechanism carries a clean latent across consecutive chunks to reduce cumulative late-chunk degradation. With four-step inference, the complete four-GPU pipeline achieves an end-to-end RTF of 1.293 at $400\times720$/$720\times400$, providing a practical quality--efficiency operating point.
Zhang, Haoyu, Li, Zhipeng, Tang, Xiaoying, Yu, Tianshu, Guo, Yiwen
Omni-ModalDialogueAvatarSpeechVideo
🧠 Agent 记忆与修正
cs.AI · 2608.10502 · 2026/08/11
记忆持久化让 agent 复用信息,也让错误持久化。本文提出 post-failure memory recovery:用 typed memory-to-action 图追踪依赖,只停用无支撑记忆、只重放答案相关的受影响计算,保留无辜状态。受控基准 85.3% 恢复率 vs 最强基线 77.3%。
▶ 原文摘要 Abstract
Persistent memory lets language-model agents reuse information across sessions, but it also makes errors durable: a poisoned, stale, or misattributed record can alter reasoning, tool use, answers, and subsequent memory writes. Existing defenses mainly detect or delete suspicious memories, or revise the current response. Deleting the source leaves already propagated claims, actions, and derived memories active, whereas resetting the store or replaying the full trace destroys benign state and repeats unnecessary computation. We therefore formulate \textbf{post-failure memory recovery: } \textit{given a failed execution and diagnosed faulty memories, recover both the answer and persistent state while retaining unaffected work.} Our \textbf{dependency-guided rollback repair} builds a typed memory-to-action graph from runtime provenance, traces explicit downstream dependencies, preserves candidates with independent trusted support, deactivates unsupported memory state, and selectively replays only answer-relevant affected computation. We evaluate this approach on a 150-case controlled benchmark spanning three tool-use domains and four memory failure types, and on a 50-case trajectory-derived stress test adapted from LongMemEval-V2. On the controlled benchmark, it achieves 85.3\% recovery versus 77.3\% for the best competing recovery method, removes all diagnosed faulty memories, preserves all benign memories, and requires only selective replay with modest LLM-call cost. On the adapted subset, it reaches 68.0\% recovery versus 54.0\% for the next best method, while also achieving the highest claim invalidation F1, 0.669 versus 0.603. Overall, the results do not imply uniformly better trace reconstruction, but show that dependency-guided rollback repair provides a strong recovery--cost trade-off while repairing faulty memory state and preserving benign memory.
Yu, Caili, Wang, Yiqi, Zhang, Jiaqi, Duan, Yiqun, Zheng, Mingkai, Wu, Zhangkai
Agent MemoryMemory RepairRollbackProvenance
cs.AI / cs.MA · 2608.10509 · 2026/08/11
多智能体工作流的共享记忆层:用 typed execution graph 追踪来源祖先,排除权限不合格记录,按语义相似度 × 乘法路径信任重排,动作执行前过风险敏感闸门。2,700 任务基准上整体任务成功率 94.96%。
▶ 原文摘要 Abstract
Shared memory helps language-model agents reuse information across long workflows, yet relevant evidence may not be admissible for a particular agent or action. Because restrictions propagate through derivations, summaries can conceal private, poisoned, untrusted, or revoked sources, enabling unauthorized reads or unsafe actions. Existing approaches provide semantic retrieval, scoped access, or lineage tracking, but do not clearly separate hard authorization from graded trust or adapt evidence requirements to action risk. We introduce MAP-Graph, a provenance-aware memory layer that represents agents, sources, memories, claims, and actions in a typed execution graph. It traces ancestry, excludes permission-ineligible records, reranks eligible memories by semantic similarity and multiplicative path trust, and applies a risk-sensitive gate before action execution while retaining affected lineage for audit. On a controlled benchmark of 2,700 synthetic tasks per method across three domains, MAP-Graph achieves 94.96\% overall task success, 72.70\% exact decision accuracy, and 90.22\% in the clean setting, where success requires a correct \textsc{Allow} rather than a safe intervention. Ablations isolate the roles of permission filtering, path trust, and action gating, while transfer tests with two additional backbones preserve the exact-decision and access-control advantages. These results support provenance as an operational control signal, rather than only post-hoc audit metadata, within the evaluated setting.
Wang, Yiqi, Yan, Zihao, Zhang, Jiaqi, Wu, Zhangkai, Zheng, Mingkai, Sun, Zequn
Multi-AgentShared MemoryProvenanceAccess Control
cs.AI · 2608.10676 · 2026/08/11
LLM 搜索 agent 不该把完整执行轨迹喂给模型(上下文无界 + 噪声)。ReTree 用树结构记忆:证据树节点存有界摘要/证据/修订历史,新证据与旧 claim 冲突时回溯到引入节点、替换过期证据、再生摘要、剪枝受影响分支、恢复搜索。准确率最高提升 25.6pp。
▶ 原文摘要 Abstract
Large language model (LLM)-based search agents answer questions through multi-step interactions with external environments. However, providing complete execution trajectories to the LLM causes unbounded context growth and introduces noise. Existing compression methods reduce context at the cost of important details and often replace erroneous facts without repairing downstream reasoning derived from them. To address this problem, we propose ReTree, a self-correcting tree-structured memory mechanism for search agents. ReTree constructs a bounded per-step reasoning context while preserving source-linked evidence. It models search as an evidence tree whose nodes store bounded summaries, evidence, and revision histories. When newly retrieved evidence contradicts an earlier claim, ReTree traces back to the node where the claim was introduced, replaces outdated evidence, regenerates summaries, prunes affected branches, and resumes search. Source-grounded evidence provenance supports reliable conflict localization and keeps final claims traceable to retrieved passages. Experiments on four public question-answering and search benchmarks show that ReTree consistently outperforms Full-Trajectory ReAct, improving answer accuracy by up to 25.6 percentage points (pp); the average maximum per-step reasoning context of Full-Trajectory ReAct is $1.27$--$1.51\times$ that of ReTree. These results establish ReTree as an effective self-correcting memory abstraction for long-horizon search.
Yang, Aijun, Guo, Qianxue, Huang, Ziyi, Chen, Yuxuan, Qian, Shiyou, Cao, Jian
Search AgentsLong-HorizonMemoryTree
🔄 自演化 / 协同演化
cs.SE / cs.AI / cs.MA · 2608.10450 · 2026/08/11
让软件项目持久、agent 短命:每个局部世界由已接受版本 + 仓库路径定位,有限生命周期的 agent 提出局部变更,递归委派跨路径移动工作,只有被接受的后果推进持久版本历史。120 小时用 DeepSeek V4 Flash 从零构建 25 万行 Rust C 编译器,成本仅 $44。
▶ 原文摘要 Abstract
Complex software systems develop over timescales that exceed the lifespan of any individual coding agent. Most agentic software systems preserve continuity through persistent sessions, memories, managers or shared context. We introduce EvoX Genesis (hereafter, Genesis), which instead makes the software project persistent while allowing local agents to remain finite-lived. Genesis represents software as a persistent recursive world: each local world is situated by an accepted version and a repository path, finite-lived agents propose local changes, recursive delegation moves work across paths, and only accepted consequences advance the persistent version history. We evaluate this organization across formation, continuation and redevelopment. Starting from a repository with no compiler implementation, Genesis used DeepSeek V4 Flash to build a Rust-based C compiler with about 250k tracked lines; the run lasted over 120 hours, archived over 1,000 agent episodes and incurred only US$44 in model-token charges. The compiler passed the complete c-testsuite and most LLVM and Csmith tests. In a separate compiler world generated with GLM 5.2, development continued after repeated agent replacement while retaining full test performance. Genesis also reimplemented 13 MESA modules with over 100k Fortran lines as a Rust workspace with nearly 90k Rust lines; across six numerical workloads, it achieved median speedups of 1.55--6.87x. These results show that long-horizon software development can be organized around a persistent project rather than a persistent agent.
Huang, Beichen, Liang, Zhenyu, Zheng, Bowen, Cheng, Ran
Self-EvolutionLong-HorizonSoftwarePersistence
cs.AI · 2608.11079 · 2026/08/11
自演化 agent 的技能库随时间膨胀。SkillZip 用「解释一次,引用多次」:重复规则提升到适用作用域、重复动作序列抽成共享过程、只保留差异为显式异常,以 typed 最小描述长度目标在硬覆盖约束下压缩技能——免评估、免 rollout。
▶ 原文摘要 Abstract
Self-evolving agents accumulate reusable skills by appending successful procedures and failure fixes. Over time, the same requirement is often restated in several branches, examples, and warnings, while common action sequences are copied rather than reused. The resulting skill becomes expensive to inject and difficult to maintain. Generic prompt compression is ill-suited to this setting because a skill is not a flat passage: its name and description define when it applies, its workflow controls execution, its tool and output contracts constrain validity, and rare exceptions may remain essential even when no sampled task activates them. Evaluation-guided compression can test these behaviors, but it introduces rollouts, cost, and dependence on the compression-time evaluation set. We present SkillZip, an evaluation-free method that compresses a skill by finding its shortest faithful structural explanation. The intuition is explain once, reference many: state a repeated rule once at the scope where it applies, factor a repeated action sequence into a shared procedure, and keep only the differences as explicit exceptions. We formalize this intuition as a typed minimum description-length objective over a skill contract and a residual, subject to a hard coverage constraint for every extracted trigger, workflow edge, tool requirement, obligation, and output field. The formulation provides simple sharing thresholds, preserves unique rare rules by construction, and supports efficient local updates. SkillZip has a one-shot mode with one structured extraction call and deterministic optimization, and a continual Zip-on-Write mode that integrates each self-evolution patch without replaying tasks or reparsing the full history. Through comprehensive experimental evaluations, we demonstrate the effectiveness and superiority of SkillZip in compression performance, generalizability, and cost overhead.
Bai, Xiaofan, Lin, Hongqiang, Liu, Chao, Zhang, Yantao, Jin, Xuan, Cao, Xipeng
SkillsSelf-EvolvingCompressionMDL
cs.CL · 2608.10299 · 2026/08/10
多组件自演化综述:Agent-Agent、Agent-Environment、Meta 三级递进分类学,追踪系统如何逐步摆脱人工设计约束——从动态同伴适应,到自适应任务/反馈/交互空间,再到让演化机制本身可演化。
▶ 原文摘要 Abstract
Agentic systems are increasingly expected to improve after deployment, yet single-entity self-evolution is often bounded by a static learning context, such as fixed tasks and feedback. This survey focuses on co-evolution in agentic systems, a multi-component form of self-evolution in which multiple agents and their environment impose adaptive pressure on one another. To organize existing papers, we propose a progressive three-stage taxonomy that traces how the system gradually sheds human-engineered constraints. Agent--Agent Co-Evolution studies how agents adapt through dynamic peers, including adversarial, collaborative, and organizational adaptation. Agent--Environment Co-Evolution extends this loop to adaptive tasks, feedback, and interaction spaces that change with the agents. Meta Co-Evolution further explores the possibility of making the evolution mechanism itself evolvable. We also discuss open challenges in evaluating such systems, scaling them across multiple components, and keeping increasingly autonomous evolutionary processes safe and controllable. This survey provides a unified foundation for building robust and open-ended agentic systems that can improve beyond fixed human-designed paths.
Zong, Qing, Liu, Jiayu, Shen, Junhao, Tang, Zecong, Wu, Linsi, Liu, Yuxuan
Multi-AgentSelf-EvolutionSurvey
cs.MA · 2608.10262 · 2026/08/10
中国前沿 LLM agent 不是铁板一块:固定转换器(GPT-5.4 Mini)消除「策略 vs 编码能力」混淆后,四家实验室(DeepSeek V4 Pro / Qwen3-Max / Kimi K2.5 / GLM-5.1)在演化囚徒困境中激进均衡比例差异显著(1%-9%),生态内差异甚至大于东西方均值差。
▶ 原文摘要 Abstract
Does the cooperative bias documented for Western frontier LLM agents extend to a different alignment lineage, and should the Chinese models that embody it be treated as a single bloc or as distinct laboratories? We study four frontier-tier Chinese models - DeepSeek V4 Pro, Qwen3-Max, Kimi K2.5 and GLM-5.1 - in an evolutionary Iterated Prisoner's Dilemma, under a design that removes a confound present in prior work. Rather than letting each model convert its own natural-language strategies into code, which entangles strategic disposition with coding ability, we hold the converter fixed (GPT-5.4 Mini) across all labs, so every cross-lab comparison is a comparison of generation alone. We run the full protocol: all-play-all tournaments and a Moran process at n=500 runs per condition, across three prompt styles and four population regimes. Two pre-registered hypotheses are evaluated. H6 (not monolithic) is supported: the four labs differ significantly in aggressive-equilibrium proportion, P_A running from 1% for Qwen3-Max to 9% for DeepSeek V4 Pro, with four of six pairwise comparisons surviving Holm-Bonferroni. The spread across the four labs (P_A range 8pp) is larger than the difference between the Chinese and Western ecosystems' mean P_A (5.0% vs 5.0%): on this measure, within-ecosystem variation exceeds the East-West gap. H5 (cooperative-bias generality) is consistent but qualified: a cooperative plurality holds in 6 of 12 lab-prompt combinations against the 9 of 12 reported for Western models, a difference we do not treat as firm, since the count rests on Cooperative-Neutral near-ties and rises to 9/12 under an alternate converter in our pre-registered robustness check. The lab, not the ecosystem, is the unit at which cooperative disposition is set; treating "Chinese models" as a monolith is not supported by the evidence.
Bolívar, Francisco León Zúñiga
Multi-AgentLLMCooperationIPD
⚙️ Agent 推理 / 运行时
cs.AI · 2608.10438 · 2026/08/11
扩散语言模型的工具调用不该是「停-等-续」:CID 把工具交互融入迭代去噪,信息需求可在文本/JSON 调用完全序列化前浮现,感知绑定在去噪继续时启动外部读取,返回结果投影进演化中的思想状态并可回修早先认知。
▶ 原文摘要 Abstract
Large language models increasingly rely on external tools to access up-to-date information, perform computation, and interact with the outside world. For autoregressive models, tool use naturally fits the generation process: the model emits a tool call, waits for the result, and then continues generating. Diffusion language models (dLLMs), however, reason by repeatedly refining many parts of their output in parallel, making this stop-and-resume interaction pattern unnecessarily restrictive. It can force tool decisions before the model's reasoning has stabilized, delay useful observations until a discrete call finishes, and introduce redundant refinement and tool execution, potentially hurting both task accuracy and inference efficiency. We introduce Continuous Interaction Diffusion (CID), a diffusion-native model--runtime architecture that integrates tool interaction into iterative denoising. CID separates a model-read-only fact channel, a thought channel represented by a Typed Cognitive Tensor, and a display channel. Information needs can emerge before a textual or JSON call is fully serialized, allowing perceptual bindings to launch external reads while denoising continues. Returned results are projected into the evolving thought state and can revise earlier cognition and display regions. Persistent bindings reuse static results without repeated external execution and refresh changing sources when needed. CID is designed to expose evidence earlier, overlap tool latency with model computation, reduce duplicate external work, and preserve useful computation after new evidence arrives. We formalize the architecture, runtime, and training objectives, and define an evaluation protocol for task quality and end-to-end efficiency. This first paper focuses on read-only tools and makes no empirical performance claims.
Cao, Yuhang
Diffusion LLMTool UseRuntime
cs.LG / cs.CL / cs.IR · 2608.10441 · 2026/08/11
「检测到平均有效」≠「能逐实例学会使用」:当奖励 SNR ρ 不高于 ρ*(N)≈2.8/√N,任何可部署策略都学不会何时获取信号——连序统计噪声 placebo 都能复现 ≥100% 的表观增益。给 LLM acquisition agents 一个可检测性下限。
▶ 原文摘要 Abstract
Many pipelines can pay a per-example cost to acquire an auxiliary, model-derived observation -- an LLM's structured reasoning, a slow oracle, an expensive measurement -- and then must decide when the acquired signal is worth using. Our thesis is a distinction that is easy to miss: detecting that such a signal helps on average is not the same as learning to act on it per instance, and a reward-SNR floor governs when the second is even possible. Even when the signal is faithful and an in-sample oracle picking the top-b examples by realized reward shows a sizable apparent gain, no deployable policy can learn when to acquire it: across per-impression, cluster, regime, and uplift-tree granularities, learned routing never beats random, and a matched-moment noise placebo reproduces >=100% of the oracle's apparent gain -- the apparent "learnable structure" is order statistics of noise. We explain this with one distinction, detecting a mean effect vs. learning a per-instance acquisition policy, and a reward-SNR detectability floor: routing is estimable offline only if the reward SNR rho clears rho*(N) ~= 2.8/sqrt(N), with a positive control confirming a true low-SNR limit rather than a broken pipeline. As a concrete instantiation we introduce Structured Hypothesis Embeddings (SHE): a frozen LLM turns a user history into ranked, confidence-scored, evidence-grounded intent hypotheses, fused into a recommender. On three public datasets (MIND, REES46, Amazon-Beauty), SHE is faithful and calibratable, yet its value is backbone- and regime-conditional (significant over an ordered GRU, +0.0114, 95% CI [+0.0030, +0.0209], but a global redundancy gap indistinguishable from zero), and learned acquisition collapses at every granularity because all three datasets sit below the floor. The realizable unit is a design-time regime gate, not a per-instance policy. We release code and a one-command reproduction.
Yuan, Ying
RLRewardSignalTheory
cs.AI / cs.LG / cs.SE · 2608.11095 · 2026/08/11
为什么 CLAUDE.md 永远在涨?作者称之为 catastrophic remembering(灾难性记忆)——遗忘的反面。1,867 仓库 247,694 条指令生命周期:prompt 无界增长(+226%,每 commit 净增 4.9 条),指令越老越删不掉。用「注释」编码潜在推理可消除 99.3% 冗余指令。
▶ 原文摘要 Abstract
Agentic coding READMEs like CLAUDE.md grow without bound in real repositories, stopping only when the repository retires or someone rewrites the file wholesale. We trace this to imperfect recall: appending an instruction is always cheap, but once an instruction's rationale is gone, deleting it without risking a correctness regression costs O(2^|D|) in a prompt of |D| instructions. We name the resulting divergence catastrophic remembering, the inverse of catastrophic forgetting around which continual learning is organized. First, we characterize this phenomenon across 247,694 instruction lifetimes in 1,867 repositories: agentic prompts grow without bound, more than tripling over their lifetime (+226%), gaining +4.9 net instructions every commit; further, the older an instruction gets, the less likely it is to be deleted (log-hazard -0.032/commit). Then, we show that prompt comments can halt the growth: inverting IFEval yields verifiable worlds whose optimal prompts are known, and there comments encoding latent reasoning remove 99.3% of excess instructions (+211.3% to +1.4%). Finally, applying the same inversion to WildIFEval, we show that prompt comments can improve real-world agentic instruction-following by up to 23.1%. If English is the new code, why don't we have comments yet?
Chakrabarti, Kushal
Agentic CodingMemoryCLAUDE.mdIFEval
cs.AI · 2608.10915 · 2026/08/11
数字 agent 改软件状态、具身 agent 改物理状态,都没把「人的状态与能动性」当作一等建模对象。ComBodied 提出人本范式:事件感知、纵向可纠正记忆、Personal World Models、可准入干预策略,形成感知-建模-预测-支持个人的闭环。
▶ 原文摘要 Abstract
After an older adult misses a medication dose, a software agent can send another reminder and an embodied agent can bring the medication. Yet neither explains whether the person forgot, is confused, has side effects, or deliberately refused, nor what support is appropriate. This reveals a structural gap in Agentic AI: Digital Agents primarily transform software states, while Embodied Agents transform physical states; neither makes a person's evolving state and agency the primary object of modeling, intervention, and evaluation. We introduce Combodied Agents, a human-centered paradigm that perceives, models, predicts, and supports individual human-state trajectories over time, using software tools, sensors, wearables, robots, and human services as action channels rather than end goals. We unify fragmented capabilities across personal assistants, health agents, AI companions, and adaptive human--AI systems into a closed loop: event-based multimodal perception reconstructs meaningful personal events; longitudinal, correctable memory provides temporal context; Personal World Models estimate future personal states and outcomes under alternative decisions and interventions; and an admissible intervention policy selects proportionate support under consent, uncertainty, safety, reversibility, and user control. Feedback from the person and environment updates the loop. Rather than requiring an exhaustive Human Digital Twin, the framework uses purpose-bounded, uncertainty-aware, user-correctable representations. We organize the design space by human-state targets, relational contexts, and agent roles, and propose scenario-centered evaluation, agency-preservation metrics, benchmark requirements, edge-native personal models, and governance directions. Combodied Agents shift Agentic AI from external task completion toward sustained human benefit.
Ding, Qianggang, Wang, Xingyao, Feng, Rui, Wang, Zhibin, Wang, Feixiang, Mao, Kelong
Human-CentricEmbodiedPersonal World ModelParadigm
🤖 生活 / 具身 Agent
cs.CL / cs.AI · 2608.10875 · 2026/08/11
现有评测都是「短请求 × 静态环境」,真实生活任务是「数周时长 × 世界持续变化 × 约束不明说」。VibeLifeBench:200 个长程任务 × 10 个生活域,模拟世界 22 个 mock 服务、自走时钟、静默变化。7 个前沿模型全部低分。
▶ 原文摘要 Abstract
Large language model (LLM) agents are increasingly deployed as personal assistants. Existing evaluations, however, mostly use short, self-contained requests in static environments. Everyday life assistance is different. A task runs for weeks rather than minutes. The world keeps changing while the agent is not being prompted. Many constraints are never stated outright. An agent that merely answers the request in front of it will fail at such a task. What is needed instead is an agent that stays proactive and consistent. It decides on its own when to act, when to ask, and when to stay silent. It notices changes that nobody announced. It keeps one plan coherent from the first day to the last. No current benchmark measures this. We introduce VibeLifeBench, a benchmark of 200 long-horizon tasks across ten everyday-life domains. Each task is a scripted multi-week timeline in a simulated world of 22 mock services. The world advances on its own clock, and many of its changes are silent, so only an agent that re-inspects the world discovers them. Every task is graded by fine-grained, weighted checks that read only what the agent actually left behind, covering the end state, the timeliness of its actions, and whether it upheld the implicit constraints. We evaluate seven frontier models. All of them score low, which shows how far current agents are from assisting with real life. We will open-source all tasks, environments, and the evaluation framework.
Inc, Xiaohongshu
BenchmarkLife AgentProactiveLong-Horizon
cs.RO · 2608.10780 · 2026/08/11
机器人策略通常只预测短视屏 chunk(局部场景演化),没有「阶段级」未来(任务如何从当前阶段推进到下一阶段)。JEPA-WAM 在 Motus-based WAM 上叠加 Stage-JEPA 目标条件预测器,50 个 RoboTwin 2.0 任务成功率 90.25%,成功 rollout 平均步数 -5.97%。
▶ 原文摘要 Abstract
Generalist robot policies aim to map multimodal observations and linguistic task instructions to actions across diverse tasks. However, existing methods typically represent the future as a fixed, short video-action chunk. This short-term future captures local scene evolution for action execution, but it does not explicitly describe the stage-level future that specifies how a task should progress from its current stage to the next. We therefore distinguish two complementary futures for robot manipulation: a short-term physical future to capture local scene evolution and a stage-level semantic future to represent task progress. We introduce JEPA-WAM, which augments a Motus-based World Action Model (WAM) with Stage-JEPA, a goal-conditioned Joint-Embedding Predictive Architecture (JEPA) predictor. Given the current observation and task instruction, Stage-JEPA uses a frozen V-JEPA2 encoder to extract the current-state representation and predicts the latent target of the next inferred stage. Across 50 RoboTwin 2.0 tasks in clean and randomized environments, JEPA-WAM achieves 90.25% overall success and reduces the mean number of execution steps in successful rollouts by 5.97% relative to the strongest baseline.
Liu, Xiao, Yang, Yuguang, Wang, Xi, Jiang, Kai, Chi, Cheng, Xu, Yong
World ModelVLARobotJEPA
🏋️ RL 训练基础设施
cs.LG / cs.DC · 2608.10402 · 2026/08/11
多轮 agentic RL 的 rollout 要反复暂停等外部环境、恢复时上下文增长、完成时间高度可变。TideRL 用就绪感知调度:Continuous Task Batching 保留 rollout 状态 + Resource-Aware Ref-Actor Pipelining + Elastic Resource Scaling。文本/多模态 agentic 工作负载上 RL 训练 goodput 最高提升 5.6×。
▶ 原文摘要 Abstract
Reinforcement learning (RL) for large language models is moving toward multi-turn agentic workloads, where rollout tasks repeatedly pause for external environments, resume with growing contexts, and finish at highly variable times. In this setting, RL training goodput, measured by training throughput, matters more than raw GPU occupancy: GPU waiting and repeated prefill recomputation are pure overhead. We present TideRL, a readiness-aware elastic RL system with Continuous Task Batching, Resource-Aware Ref-Actor Pipelining, and Elastic Resource Scaling. CTB preserves useful rollout state, $\textrm{RA}^2\textrm{P}$ selects between decoupled streaming and colocated aggregation from the ready backlog and arrival interval, and ERS moves ranks between rollout and training using the same readiness signals. Across text-only and multi-modal agentic workloads, TideRL improves RL training goodput by up to 5.6$\times$ over synchronous baselines and over 33% over asynchronous baselines, while reaching similar task performance. It also improves KV cache hit rate by 1.58$\times$, reduces per-step training time by up to 44.3%, and cuts total waiting time by up to 77.6%.
Ren, Yanyu, Wang, Xizheng, Liu, Xiao, Lv, Bowen, Zhang, Hanchen, Zhang, Shudan
RLAgenticSchedulingInfra
🔍 Duplex / Turn-Taking 专项扫描
全量候选扫描:命中 2 篇(专项扫描已执行,非漏扫)
对今日全部 270 篇候选标题做 duplex/full-duplex/turn-taking/barge-in/realtime/voice-agent 关键词扫描,命中 2 篇与全双工交互直接相关:
1.
X2-Turn(eess.AS/cs.CL)— 流式 ASR 上帧级轮转状态预测,实时区分打断/backchannel/语轮完成。
2.
Ex-Omni-2D(cs.AI/cs.CL/cs.CV)— 全模态对话 + 个性化语音 + 视觉呈现,语音单元作为声学-时间接口与视频帧在线对齐。
说明:DuplexWorld(2608.10716)不在今日候选池(提交于 8/11,8/12 已由你人工指定精读),今日无去重冲突。相邻候选还有 ASR-Roundtrip TTS 评测(2608.10606)等语音质量相关论文,未达 duplex 核心标准。
📚 知识库更新
AgentTeam-Shared-Knowledge:今日 0 条新提交
digest 输出 head=checkpoint=cd612df3,本地副本无增量。
⚠️ 诚实标注:本地副本仍停留在 8/5 的 cd612df3,外部同步进程未按预期运行,且容器内 GitHub 未连接(无凭证注入)。「0 条」只代表本地过期副本的状态,不代表上游真实情况——若你近期在知识库推送了内容,此处不会反映。
📖 Zotero 动态
近期新增集中于:Agent Training、GUI & Web Agents、Agent Architecture、Agentic RL
高松灯 / Agent 日报 · 2026-08-13 · 数据来源 arXiv