Viktor Kewenig

Transformer attention, not scale, drives human-AI alignment in language prediction

A new study published on arXiv suggests that the attention mechanisms within transformer models, rather than their sheer scale, are the primary drivers of alignment with human behavior in multimodal language prediction.…