A user has compiled a substantial dataset of 160GB, comprising 40 billion tokens of English text from the 1800s (specifically 1800-1875) sourced from England and the United States. An initial evaluation model with 500 million parameters has been trained on a 5 billion token sample of this dataset. This model has also been fine-tuned on question-and-answer pairs derived from the dataset, enabling it to respond to queries about historical figures, places, and events, though its accuracy is currently limited as it is an evaluation model. AI
IMPACT Demonstrates the potential for specialized LLMs trained on historical data to answer specific domain questions.
RANK_REASON User-generated research project releasing a model trained on a specific historical dataset. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
