Yann Dubois

LLM construction: Data, post-training, and evaluation are key, not just architecture

Most explanations of how large language models (LLMs) are built focus on architecture and attention mechanisms, neglecting crucial aspects like data pipelines, post-training techniques, and evaluation methods. A detaile…