Revolut has significantly reduced its AI coding costs by migrating approximately 2,000 developers from paid APIs to a self-hosted GLM model. This transition, utilizing 56 Nvidia B200 GPUs, has decreased token costs by about 90%, from an unspecified previous rate to approximately $0.30 per million tokens. The company reports this change has improved coding time by 60% and lead time by 70%, though the substantial hardware investment of around $2 million for the GPUs and ongoing tuning makes this solution more feasible for large financial institutions than for small to medium-sized businesses. AI
IMPACT Demonstrates significant cost reduction potential for enterprises by self-hosting LLMs, potentially influencing future AI infrastructure investment decisions.
RANK_REASON This is a case study of a company implementing and optimizing AI tools for cost savings and efficiency, rather than a core AI release or research milestone.
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →