Unbounded Labs has developed Bart, a 2.82 billion parameter large language model trained on 20.1 billion tokens of English text predating 1931. The project, self-funded at approximately $800, aimed to explore whether LLMs could replicate the scientific reasoning of historical figures. Bart achieved top performance on the newly created Vintage CORE benchmark for its scale and demonstrated efficient training, completing its final training run in five days on an H100 GPU. AI
IMPACT This release explores the potential for LLMs to engage in historical scientific reasoning and introduces new benchmarks for evaluating such capabilities.
RANK_REASON The cluster describes the release of a new LLM with a specific training corpus and benchmarks, fitting the research category. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
