[P] Built a portable GPU ISA after reading too many architecture manuals [P]
A new portable GPU instruction set architecture (ISA) called WAVE has been developed, aiming to unify programming across different hardware vendors. WAVE abstracts common functionalities found in NVIDIA, AMD, and Intel GPUs, allowing developers to write kernels once and compile them for various backends like Metal, PTX, HIP, or SYCL. This approach has been demonstrated to produce identical training results on hardware from Apple, NVIDIA, and AMD. AI
IMPACT Enables unified development across diverse GPU hardware, potentially streamlining AI model training and deployment.