Revolut has transitioned approximately 2,000 developers from paid APIs to a self-hosted Generative Language Model (GLM) setup. This new infrastructure, utilizing 56 Nvidia B200 GPUs, reportedly reduces token costs by about 90% to $0.30 per million tokens. The company claims this move has led to a 60% reduction in coding time and a 70% decrease in lead time, though the significant hardware investment of around $2 million makes it a more feasible option for large financial institutions than for small to medium-sized businesses. AI
IMPACT Demonstrates significant cost savings and efficiency gains by self-hosting LLMs, potentially influencing other large organizations to adopt similar strategies.
RANK_REASON Company's internal infrastructure shift and cost savings on AI tooling.
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →