← 首页|学术|A Storage-Retrieval Gap in Parametric Knowledge Graph Memory
cs.LG, cs.CL, cs.IR · 2608.25489 · 2026-08-26

A Storage-Retrieval Gap in Parametric Knowledge Graph Memory

Martino M. L. Pulici, Cuong Xuan Chu, Evgeny Kharlamov, Volker Tresp
参数化记忆知识图谱LoRA
💬 把知识图谱离线编译成每实体一个LoRA adapter、注入权重而非塞进context来查询,零查询时上下文开销;但发现存储的知识无法靠相似度检索——知识存储是局部的、不可迁移的,揭示了参数化记忆的一个根本性开放问题。

🎯 背景

图检索增强生成在查询时把检索到的子图放进上下文窗口,需要付出持续的token成本,并且每次调用都会暴露源数据。作者研究一种替代方案:把知识图谱离线编译进一组LoRA adapter(每个实体一个),作为通过注入权重而非文本查询的参数化知识层,实现零查询时上下文成本。

🔬 方法

在MetaQA数据集上评估子图训练的adapter是否编码了可泛化到未见问题的、与上下文无关的事实知识,并测试能否用嵌入相似度或权重空间几何检索来定位正确的adapter。

📊 结果

单值关系上adapter相对几乎闭卷盲猜的基座模型(0.007)获得+0.243精确匹配增益,且只有正确的adapter能恢复这一知识(oracle差距+0.283),证明存储可行;但给定无子图的查询时,基于嵌入和权重空间几何的检索都表现为随机水平——语义相邻实体的adapter并不包含答案,知识存储是局部的、不可迁移的。权重几何与子图语义相关(ρ=+0.329)但与功能可检索性无关,作者据此认为"用非语义相似度机制选择/组合正确adapter"是核心开放问题,呼吁一种可学习的、查询条件化的组合机制。

原文摘要

▶ Abstract
Graph retrieval-augmented generation places retrieved subgraphs into the model's context window at query time, paying a recurring token cost and exposing source data on every call. We study an alternative: compiling a knowledge graph offline into a bank of LoRA adapters, one per entity, that serve as a parametric knowledge layer queried by injecting weights rather than text, at zero query-time context cost. On the MetaQA dataset, we find that subgraph-trained adapters encode context-free factual knowledge that generalizes to unseen questions: on single-valued relations the adapter gains $+0.243$ exact-match score over a base model that is nearly blind closed-book ($0.007$), and only the correct adapter recovers this knowledge (an oracle gap of $+0.283$ over the base model). However, the stored knowledge is not recoverable by similarity: given a query with no subgraph, embedding-based and weight-space geometry retrieval both perform at chance, because a semantically neighbouring entity's adapter does not contain the answer - knowledge is stored locally and does not transfer. Weight geometry correlates with subgraph semantics ($\rho = +0.329$) but not with functional retrievability. We quantify the byte and context-token costs against graph retrieval-augmented generation and discuss deployment implications. Our results establish that parametric knowledge graph memory is feasible for storing knowledge, and identify selecting and composing the right adapters by a mechanism other than semantic similarity as the central open problem - motivating a learned, query-conditioned composition mechanism.
来源: arXiv:2608.25489 · 精读由高松灯生成,基于摘要与 arXiv 页面信息