← 首页|学术|VibeLifeBench: 生活 agent 能否主动且持续?
cs.CL / cs.AI · 2608.10875 · 2026/08/11

VibeLifeBench: Can Your Life Agent Be Proactive and Persistent in a Living World?

Inc, Xiaohongshu
TL;DR:现有评测都是「短请求 × 静态环境」,真实生活任务是「数周时长 × 世界持续变化 × 约束不明说」。VibeLifeBench:200 个长程任务 × 10 个生活域,模拟世界 22 个 mock 服务、自走时钟、静默变化。7 个前沿模型全部低分。

🎯 问题

生活助手需要主动、持续、自己决定何时行动/询问/沉默、发现无人宣布的变化、把计划从第一天保持到最后一天——但现有评测只测「回应眼前请求」的 agent。

🔬 方法

200 个长程任务 × 10 个生活域;每个任务是模拟世界中脚本化的多周时间线,22 个 mock 服务,世界按自身时钟推进且许多变化是静默的,只有主动复查世界的 agent 才能发现;细粒度加权检查只读 agent 实际留下的痕迹,覆盖终态、行动及时性与隐含约束。
章节结构(全文标题提取):
1 Introduction
2 VibeLifeBench
3 Evaluation
4 Experiments
5 Analysis
6 Related Work
7 Conclusion
Contribution
2.1 Design Principles · 2.2 Task Definition · 2.3 Construction Pipeline · 2.4 Data Distribution · 3.1 Executing a run · 3.2 Scoring · 3.3 Evaluation infrastructure and agent harness · 4.1 Main results

📊 结果

7 个前沿模型全部得分很低——当前 agent 离真实生活协助还很远。

💡 与研究方向关联

生活 agent 的核心能力是主动性与持续性(proactivity & persistence)。静默变化设计让 benchmark 测的不是「接得住请求」,而是「会不会自己去看」。与 Duplex 交互同源:真正的助手要在没人提示时行动。

📝 原文摘要

▶ 原文摘要 Abstract
Large language model (LLM) agents are increasingly deployed as personal assistants. Existing evaluations, however, mostly use short, self-contained requests in static environments. Everyday life assistance is different. A task runs for weeks rather than minutes. The world keeps changing while the agent is not being prompted. Many constraints are never stated outright. An agent that merely answers the request in front of it will fail at such a task. What is needed instead is an agent that stays proactive and consistent. It decides on its own when to act, when to ask, and when to stay silent. It notices changes that nobody announced. It keeps one plan coherent from the first day to the last. No current benchmark measures this. We introduce VibeLifeBench, a benchmark of 200 long-horizon tasks across ten everyday-life domains. Each task is a scripted multi-week timeline in a simulated world of 22 mock services. The world advances on its own clock, and many of its changes are silent, so only an agent that re-inspects the world discovers them. Every task is graded by fine-grained, weighted checks that read only what the agent actually left behind, covering the end state, the timeliness of its actions, and whether it upheld the implicit constraints. We evaluate seven frontier models. All of them score low, which shows how far current agents are from assisting with real life. We will open-source all tasks, environments, and the evaluation framework.
Deep Read · 2026-08-13高松灯 / Agent 日报
BenchmarkLife AgentProactiveLong-Horizon