← 首页|学术|SEER: Long-Context Reasoning via Selective Visual-Text Compression
cs.CL, cs.CV · 2608.15962 · 2026/08/16

SEER: Long-Context Reasoning via Selective Visual-Text Compression

Xu, Jiawei, Zhai, Zhilin, Fang, Jinrui, Xu, Ruohan, Lu, Mingfei
TL;DR:SEER:选择性视觉-文本压缩做长上下文推理——学习用视觉扫描挑 query 相关的图像,只在需要处检索文本内容,把视觉压缩的效率与文本推理的精度结合;在工具交互轨迹上 SFT 学会自适应工具调用(select + retrieve)。

🎯 问题

长上下文推理因 attention 二次复杂度而昂贵;视觉压缩(把文本渲染成图喂给 VLM)能减 token,但现有方法不管 query 相关度一律均匀压缩,在需要精读处牺牲精度。

🔬 方法

SEER 学习「视觉扫描选择 query 相关图像 + 只在需要处检索文本」;通过工具交互轨迹上的 SFT 学自适应工具调用(select/retrieve);把压缩效率与文本精度结合。
章节结构(全文标题提取):
1 Introduction
2 Related Work
3 Problem Setup
4 Method
5 Experiments
6 Results
7 Conclusion
Limitations
Acknowledgments

📊 结果

长上下文 benchmark 上比均匀压缩基线提升提取精度,同时保持视觉压缩的 token 节省。

💡 与研究方向关联

长上下文效率与精度的权衡——「哪里该压、哪里该精读」的决策本身变成可学策略。与 agent 处理海量上下文的资源分配问题相关,也贴近多模态输入的实时性诉求。

📝 原文摘要

▶ 原文摘要 Abstract
Long-context reasoning remains computationally expensive for large language models due to the quadratic complexity of attention over text tokens. Visual-text compression offers a promising alternative by rendering text into images and processing them with vision-language models, often reducing token usage. However, existing approaches apply uniform compression regardless of query relevance, potentially sacrificing precision where detailed extraction is required. We present SEER, a framework that learns to select query-relevant images through visual scanning and retrieve textual content only where needed, combining the efficiency of visual compression with the precision of text-based reasoning. Through supervised fine-tuning on tool-interaction trajectories, SEER learns adaptive tool invocation for selection and retrieval. Experiments on long-context benchmarks show that SEER improves extraction precision through selective text retrieval while retaining average prompt-token savings relative to full-text baselines. On LongBench, SEER achieves 51.11% average accuracy, outperforming the visual-text baseline Glyph-9B by 2.33 points and Qwen3-8B by 3.49 points. Code can be accessed at https://github.com/jiaweixu98/SEER
Deep Read · 2026-08-19高松灯 / Agent 日报 · 推理与多模态
长上下文多模态视觉压缩选择性检索