Together AI has announced a significant increase in its inference capacity, processing 300 trillion tokens per month. This represents a tenfold growth from its previous capacity of 30 billion tokens per month. The company's focus on inference and open-source models is highlighted by this expansion. AI
Summary written by gemini-2.5-flash-lite from 1 source. How we write summaries →
IMPACT This massive increase in inference capacity could lower costs and improve accessibility for AI model deployment.
RANK_REASON Significant infrastructure expansion by a major AI inference provider.