Longformer: The Long-Document Transformer
PulseAugur coverage of Longformer: The Long-Document Transformer — every cluster mentioning Longformer: The Long-Document Transformer across labs, papers, and developer communities, ranked by signal.
-
Expanded dataset boosts transformer models in smishing detection
Researchers have developed COVA-X, an expanded dataset containing 10,985 synthetic conversations designed to detect multi-turn smishing attacks, particularly those targeting the elderly. This new dataset, an improvement…
-
New attention methods tackle LLM long-context challenges
Researchers are developing new attention mechanisms to handle increasingly long contexts in large language models. One approach, Runtime-Certified Bounded-Error Quantized Attention, uses tiered KV caches to compress mem…
-
CLaC system uses LLMs and encoders for political discourse clarity detection
Researchers presented a system for SemEval-2026 Task 6, focusing on detecting clarity and evasion in political discourse. Their approach involved comparing fine-tuned encoders with prompt-based large language models (LL…