10 Models Tested: From 81.6% to 10%. The Free Tier is a Full-On Gamble.
A recent test of ten AI models on coding tasks revealed significant performance disparities, particularly within free tiers. Grok 4.3 emerged as the top performer with an 81.6% success rate, while Perceptron Mk1 offered exceptional value at nearly 80% for a minimal cost. Among free models, Owl Alpha stood out with a 76.7% score and no hard failures, though latency was a concern. Other models like GPT Chat Latest and Mistral Medium 3.5 showed mixed results, with the former being the most expensive and the latter experiencing timeouts. AI
IMPACT Highlights the significant cost and performance differences between AI models, especially free tiers, impacting developer choices and tool selection.