A new software acceleration layer called VKORE enables Neural Processing Units (NPUs) to be used for AI model training, not just inference. In performance tests, pretraining throughput on an NPU using VKORE surpassed a single Nvidia H100 by 170% and approached a Nvidia B200 at 75%. This development allows for "sovereign compute" by enabling full AI model development cycles on non-Nvidia hardware, addressing supply and policy concerns that limit access to GPUs in certain markets, particularly in China. AI
IMPACT Enables full AI model development cycles on non-Nvidia hardware, potentially reducing reliance on GPU supply chains and lowering training costs.
RANK_REASON New software enables a new class of hardware (NPUs) to perform a critical AI task (training) previously exclusive to a dominant vendor's hardware (Nvidia GPUs), impacting data center economics and sovereign compute initiatives. [lever_c_demoted from significant: ic=1 ai=1.0]
- AI accelerator
- Alibaba Group
- Baidu
- Cambricon
- China
- CUDA
- Huawei
- Neural Processing Units
- Nvidia
- Nvidia B200
- NVIDIA H100
- VKORE
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →