d-Matrix has unveiled its Raptor AI accelerator, which features a novel 3D stacking architecture. This design places a TSMC 4nm compute die directly on top of a custom-designed DRAM die, achieving an unprecedented 100 TB/s of bandwidth per card. The company claims this approach significantly reduces energy consumption for data transfer compared to traditional HBM-based designs and projects substantially higher throughput for generative inference tasks. AI
IMPACT This novel 3D stacking approach could significantly boost AI inference performance and efficiency, potentially lowering costs and enabling more powerful on-device AI.
RANK_REASON New hardware architecture for AI accelerators with significant performance claims. [lever_c_demoted from significant: ic=1 ai=0.7]
- Alchip
- DRAM
- HBM4
- Hot Chips 2026
- ISCA 2026
- Kimi K3
- Raptor
- Sid Sheth
- Sudeep Bhoja
- TSMC
- University of British Columbia
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →