Sequel for my H100 blog is out now.
We implement Blackwell matmul for NVFP4 from scratch, and outperform cuBLAS by 4.7% at N=8192.
This time we have something better than Hilbert curves - that exact-fits for the Nvidia hardware.
Full blog post with all details:
Show more
