OpenAI has developed its own 700W inference ASIC, codenamed Jalapeño, in collaboration with Broadcom. Benchmarks presented by OpenAI suggest that Jalapeño outperforms Nvidia's GB200 and GB300 GPUs in throughput per kilowatt and latency, particularly on open-source models like GPT-OSS 120B and Moonshot AI's Kimi K2.5. The company plans to deploy these chips in its own data centers later this year, potentially impacting the high-bandwidth memory (HBM) supply chain as it scales up. AI
IMPACT This development could signal a shift in AI hardware development, potentially impacting the supply chain for high-bandwidth memory and challenging Nvidia's dominance in AI accelerators.
RANK_REASON OpenAI's announcement of its own inference ASIC with performance benchmarks against a major competitor's flagship GPU. [lever_c_demoted from significant: ic=1 ai=0.7]
- AMD
- Broadcom
- DeepSeek R1 670B
- GB200
- GB300
- GPT-OSS 120B
- jalapeño
- Kimi K2.5
- Micron
- Moonshot AI
- NVIDIA
- OpenAI
- Samsung
- SK Hynix
- Vera Rubin
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →