PulseAugur
EN
LIVE 10:10:19

Together AI scales inference to 300T tokens per month, a 10,000x increase YoY

Together AI has announced a significant increase in its inference capacity, processing 300 trillion tokens per month. This represents a tenfold growth from its previous capacity of 30 billion tokens per month. The company's focus on inference and open-source models is highlighted by this expansion. AI

IMPACT This massive increase in inference capacity could lower costs and improve accessibility for AI model deployment.

RANK_REASON Significant infrastructure expansion by a major AI inference provider.

Read on X — Together (inference / OSS) →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Together AI scales inference to 300T tokens per month, a 10,000x increase YoY

COVERAGE [1]

  1. X — Together (inference / OSS) TIER_1 English(EN) · togethercompute ·

    RT @vipulved: 30B -> 300T tokens per month YoY @togethercompute

    RT @vipulved: 30B -> 300T tokens per month YoY @togethercompute