← 首页|学术|The Sleeping Agent: What Gist-Based Context Compression Loses and Why
cs.AI / cs.CL · 2608.11775 · 2026/08/12

The Sleeping Agent: What Gist-Based Context Compression Loses and Why

Kyrkewood, Nicholas E.
TL;DR:Gist式上下文压缩(把旧对话摘要成紧凑表示)对多跳推理与单跳事实问答显著优于截断,但时间类问题大幅变差——因为摘要提示保留关系/事件结构却丢弃了日期与时间。

🎯 问题

长时程Agent常用gist压缩,但压缩对不同类型记忆检索的影响(何时有帮助、何时有害)未被理解。

🔬 方法

Salience-Weighted Consolidation (SWC),睡眠式记忆巩固启发的压缩框架作为诊断探针:按显著性打分、分层级、对中优先级做结构化gist抽象;10段LoCoMo对话1,935个匹配问题。
章节结构(全文标题提取):
1 Introduction
2 Background
3 Related Work
4 Salience-Weighted Consolidation
5 Experimental Setup
6 Results
7 Discussion
8 Conclusion
2.1 Two-Stage Model and Selective Replay
2.2 Forgetting as Function
2.3 Episodic Specificity and Gist
3.1 Context Management
3.2 Memory Systems
4.1 Design Principles
4.2 Stage 1: Salience Scoring
4.3 Stage 2: Gist Abstraction — SWC-Full
4.4 Stage 2: Gist Abstraction — SWC-Temporal
4.5 Scheduling
5.1 Benchmark and Coverage
5.2 Conditions

📊 结果

压缩在多跳/单跳事实大幅优于截断,但时间问题远低于全文基准;一行提示修改使时间表达保留率从3.05%提升到62.39%(约20倍),而命名实体与事件保留率几乎不变。

💡 与研究方向关联

上下文压缩与记忆检索类型的交互:gist 压缩丢时间信息是机制性失败而非概率性退化。对长时程 agent 的上下文管理有实用诊断价值。

📝 原文摘要

▶ 原文摘要 Abstract
Gist-based context compression---summarising older conversation history into compact representations---is a common approach in long-horizon language model agents, yet its effect on different types of memory retrieval is poorly understood. We use Salience-Weighted Consolidation (SWC), a biologically-inspired compression framework motivated by sleep-based memory consolidation, as a diagnostic probe to study when gist compression helps and when it hurts. SWC scores conversation history by salience, partitions it into priority tiers, and applies structured gist abstraction to mid-priority content. Evaluating four conditions on all ten LoCoMo conversations---1,935 matched text-only questions in total, 1,501 used in the primary aggregate after excluding Category 5 (adversarial) questions---at temperature 0, we find a consistent task-type interaction: gist compression substantially outperforms truncation on multi-hop reasoning and single-hop factual questions, but temporal questions remain substantially harder under compression, with compressed conditions scoring well below the full-context reference on the conversations where both are evaluated. We trace this failure to a specific mechanism: the gist abstraction prompt preserves relational and event structure while discarding dates and times. A preservation analysis across all ten conversations confirms the mechanism: an approximately 20-fold increase in temporal expression preservation (3.05% to 62.39%) with a one-sentence prompt modification, while named entity and event preservation rates barely change (x1.02 and x1.11), demonstrating that the fix is a precision instrument. The prompt modification recovers +0.314 [0.254, 0.375] judge accuracy on category-2 (temporal) questions in the matched set. Code and results: https://github.com/kyrkewood/sleeping-agent.
Deep Read · 2026-08-14高松灯 / Agent 日报
Context CompressionGist SummarizationLong-Horizon AgentMemory Consolidation