Particle physics models engineered for data-driven scaling laws

Researchers are exploring how to engineer scaling laws for models in particle physics, drawing parallels to large language models. Unlike natural language or image domains, fundamental physics benefits from high-fidelity simulators that generate synthetic data affordably. This allows for dataset engineering to influence model scaling, favoring more data over larger parameters. For the task of classifying hadronic jets, a study demonstrated that by including diverse and task-aligned pretraining data, the scaling behavior could be shifted towards requiring more data. AI

IMPACT This research could lead to more efficient model training in scientific domains by optimizing data composition.

RANK_REASON Academic paper on scaling laws in particle physics. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

• arXiv
• hadronic jets
• Hugging Face
• large-language models
• Neural Scaling Laws
• particle physics

• paper
• infra

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →