English(EN)End-to-End Context Compression at Scale
新的大语言模型上下文压缩技术提高了效率和准确性
作者PulseAugur 编辑部·[8 个来源]·
研究人员正在开发用于大语言模型上下文压缩的新方法，以提高效率和性能。一种名为“Telegraph English”的方法将检索到的段落重写为结构化的实体-关系语句，在问答任务上的表现优于传统的压缩技术。另一种方法 Sentinel 使用注意力探测来解码大语言模型的上下文利用情况，从而实现高效压缩，并在较小的模型上取得了显著的提升。此外，潜在上下文语言模型（LCLMs）提供了一个端到端的编码器-解码器框架，提高了长上下文推理和代理任务的准确性-效率前沿。
AI
arXiv:2606.14875v1 Announce Type: new Abstract: We study context compression for multi-hop question answering with small language models. We propose Telegraph English, a readable symbolic format that rewrites retrieved passages into structured entity-relation statements, preservi…
arXiv cs.AI
TIER_1English(EN)·Yong Zhang, Heng Li, Yanwen Huang, Ning Cheng, Yang Guo, Yun Zhu, Yanmeng Wang, Shaojun Wang, Jing Xiao·
arXiv:2505.23277v3 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) often suffers from long and noisy retrieved contexts. Existing context compression methods typically rely on heuristic relevance estimation or supervised compression models rather than …
arXiv cs.AI
TIER_1English(EN)·Ang Li, Sean McLeish, Haozhe Chen, Nimit Kalra, Zaiqian Chen, Artem Gazizov, Venkata Anoop Suhas Kumar Morisetty, Bhavya Kailkhura, Harshitha Menon, Zhuang Liu, Brian R. Bartoldson, Tom Goldstein, Sanae Lotfi, Micah Goldblum, Pavel Izmailov·
arXiv:2606.09659v1 Announce Type: cross Abstract: Long-context language model inference is bottlenecked by memory, as the KV cache grows with context length. Recent techniques to compress the KV cache fall short: they either degrade model quality substantially or require consider…
Long-context language model inference is bottlenecked by memory, as the KV cache grows with context length. Recent techniques to compress the KV cache fall short: they either degrade model quality substantially or require considerable time and compute to compress a single long pr…
Long-context language model inference is bottlenecked by memory, as the KV cache grows with context length. Recent techniques to compress the KV cache fall short: they either degrade model quality substantially or require considerable time and compute to compress a single long pr…
Encoder-decoder compression techniques are improved through architectural search and large-scale pretraining to create Latent Context Language Models that efficiently handle long contexts with better performance and memory usage compared to traditional KV cache methods.
dev.to — LLM tag
TIER_1English(EN)·Gabriel Anhaia·
