Pretrained Language Models
PulseAugur coverage of Pretrained Language Models — every cluster mentioning Pretrained Language Models across labs, papers, and developer communities, ranked by signal.
-
New benchmark TAHB integrates text-attributed hypergraphs for AI research
Researchers have introduced TAHB, the first public benchmark designed to integrate text-attributed hypergraph structures with raw textual data. This benchmark comprises 10 real-world datasets spanning e-commerce, academ…
-
New survey details semantic role labeling in the era of LLMs
A new survey paper provides a comprehensive overview of semantic role labeling (SRL) within the context of modern pretrained language models. The paper introduces a four-dimensional taxonomy to categorize SRL research, …
-
New theory explains AI's balance of generalization and memorization
Researchers have developed a new mathematical theory to explain how learning systems balance generalization with memorization of exceptions. They introduced a novel task, transitive inference with exceptions, to study t…