A new family of Japanese large language models, LLM-jp-4, has been introduced, featuring an 8B dense model and a 32B mixture-of-experts model. These models were trained on approximately 12 trillion tokens with a focus on transparency and reproducibility. Evaluations show significant improvements over previous LLM-jp versions and competitive performance against similar-scale open-weight models. AI
IMPACT Provides a reference for future sovereign AI development with transparent and reproducible LLM training.
RANK_REASON The cluster describes a technical report detailing a new family of large language models, including their architecture, training data, and evaluation results. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- CatalyzeX
- Connected Papers
- DagsHub
- Gotit.pub
- Hugging Face
- Litmaps
- LLM-jp-4
- ScienceCast
- Scite
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →