Fireworks
@FireworksAI_HQ
The frontier platform for training and inference on open-weights models at scale.
参加 September 2022
280 フォロー中 29.4K ファン
Long-context sparse attention has a catch: data-dependent block selection wrecks memory access kills speed.
Our @MiniMax_AI M3 kernel on Blackwell answers it. KV-stationary, each block read once, ~980 TFLOP/s on a B200.
See the breakdown here →
もっと見る
