ENTITY yliusci/length-is-cheap

yliusci/length-is-cheap

PulseAugur coverage of yliusci/length-is-cheap — every cluster mentioning yliusci/length-is-cheap across labs, papers, and developer communities, ranked by signal.

Show in brief

Total · 30d

1 over 90d

Releases · 30d

0 over 90d

Papers · 30d

1 over 90d

TIER MIX · 90D

TOPICS

paper 1
model release 1

SENTIMENT · 30D

1 day(s) with sentiment data

RECENT · PAGE 1/1 · 1 TOTAL

RESEARCH · CL_341135 · Nov 3 · 00:00

Language models struggle with long inputs due to attention competition, not length

A new study reveals that language models struggle with long inputs not due to sequence length itself, but due to "competition" for attention within the model. Researchers found that neutral filler text had minimal impac…

Language models struggle with long inputs due to attention competition, not length