What are some cool little things you guys are doing with < 10b models?
A Reddit discussion on the r/LocalLLaMA subreddit explores creative applications for smaller language models, specifically those under 10 billion parameters. Users shared ideas such as using Qwen for OCR and formatting scanned documents in Indian languages into EPUBs. Other participants highlighted the potential of models like Gemma e4b for handling extended contexts and the general utility of 2 billion parameter models for novel projects. AI
IMPACT Showcases community innovation and potential niche applications for smaller language models.