mxfp8 x mxfp4 at higher perf than normal mxfp8 matmul is a magic bullet worth pointing out. Kudos to Richard Ho and the team, this is good engineering.
That’s 2x activation fetches plus scale sidecar concurrently on the fp8 to match the fp4 native element sizes. Not trivial