A user reflects on training a small LLM approximately one to two years ago using a custom dataset comprising their Mastodon posts, personal writings, code, and Q&A factoids, supplemented by open datasets like SQuAD. The user notes that the initial model was not highly intelligent but improved over time, with training primarily conducted on personal hardware and partially on a cloud platform due to cost considerations. AI
RANK_REASON The item describes a personal anecdote about training a small LLM, which does not constitute a significant industry event, research breakthrough, or product release.
Read on Mastodon — fosstodon.org →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →