A user attempted to use Sarvam 30B and 105B models for Indian language tasks such as translation and entity extraction, but found them to be ineffective. The models frequently repeated tokens and failed to follow instructions, regardless of prompt engineering or configuration adjustments. In contrast, the Qwen 3.8 27B model performed surprisingly well on the same tasks. AI
IMPACT Highlights potential issues with Sarvam models for Indian languages and suggests Qwen as a viable alternative.
RANK_REASON User experience report on model performance.
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →