multi-billion parameter

Small language models show advanced entity tracking, surpassing human performance

A new study published on arXiv demonstrates that language models, even those with fewer than a billion parameters, exhibit strong entity tracking capabilities. This ability, crucial for understanding discourse, emerges …