NVIDIA NeMo-RL

Frontier LLMs struggle with multi-GPU kernel generation, new benchmark reveals

A new benchmark called ParallelKernelBench (PKB) has been developed to evaluate the ability of frontier large language models to generate efficient multi-GPU kernels. Testing models like GPT-5.5, Gemini 3 Pro, and Opus …