Fireworks
@FireworksAI_HQ
The frontier platform for training and inference on open-weights models at scale.
Joined September 2022
280 Following 29.4K Followers
Long-context sparse attention has a catch: data-dependent block selection wrecks memory access kills speed.
Our @MiniMax_AI M3 kernel on Blackwell answers it. KV-stationary, each block read once, ~980 TFLOP/s on a B200.
See the breakdown here →
Show more
