Thien Tran(@gaunernst):Thank you for everyone who commented on other public MXFP8 kernels that I didn't know about. At least for the toy 8192^3 benchmark shape here, K3-generated Gluon is the best 😳 I haven't checked all the kernels closely but I'm sure they can shine under different GEMM shapes + tuning knobs. Having an assemble of kernels is useful for autotuning

2026.09.04 23:21

Thank you for everyone who commented on other public MXFP8 kernels that I didn't know about. At least for the toy 8192^3 benchmark shape here, K3-generated Gluon is the best 😳 I haven't checked all the kernels closely but I'm sure they can shine under different GEMM shapes + tuning knobs. Having an assemble of kernels is useful for autotuning - it is effortless thanks to agents now.

显示更多

Thien Tran@gaunernst

2026.09.04 16:00

I couldn't find a public performant MXFP8 GEMM on MI355X, so I just asked @KimiDevs K3 to write one, and it beats torch._scaled_mm by >2x times 🤯 This is an adaptation of the official Gluon MXFP4 example. FlyDSL adaptation is WIP. @AnushElangovan you guys should try K3 for kernel engineering if you haven't!

显示更多