A new research paper demonstrates that pre-trained language models can effectively perform social science tasks like record linkage and demographic inference without task-specific training. The proposed EnsembleLink algorithm, utilizing pre-trained embeddings, matches or surpasses existing methods for record linkage and generalizes across various scripts and formats. For ethnicity inference from names, large language models achieved up to 83.8% accuracy on U.S. voter files, outperforming traditional methods and showing potential for inferring group membership beyond the U.S. and reducing bias in demographic estimates. AI
IMPACT Demonstrates LLMs' potential to reduce data acquisition costs and bias in social science research.
RANK_REASON Research paper detailing a new methodology for using LLMs in social science. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →