To Infinity and Beyond: ThunderKittens Now on NVIDIA Vera Rubin NVL72!
To Infinity and Beyond: ThunderKittens Now on NVIDIA Vera Rubin NVL72!
摘要
We ported ThunderKittens to NVIDIA's Vera Rubin NVL72 and rebuilt our NVFP4 GEMM around the new hardware, taking it from 42% of roofline to over 22 PFLOPS — competitive with cuBLAS and CuTe DSL. Here is what changed in the ISA and how we used it.
We ported ThunderKittens to NVIDIA's Vera Rubin NVL72 and rebuilt our NVFP4 GEMM around the new hardware, taking it from 42% of roofline to over 22 PFLOPS — competitive with cuBLAS and CuTe DSL. Here is what changed in the ISA and how we used it.
译自 Together AI · 官方 · 录于 二〇二六年九月十日