Dolma3

New research maps origins of social reasoning in language models

Researchers have developed a method to understand the origins of social reasoning capabilities in language models by analyzing their training data. Using gradient-based attribution on the Dolma3 dataset, they mapped spe…