After seeing so many good example results out of the MiMo v2.6 Pro RL
I setup a recipe using Jarrelscy AVRQ hybrid quantization which is the first time i’m using this type of quantization on Four DGX-sparks with sm-121 since Jarrelscy recipe is for SM120. Adapted and wrote a script for it to work on the SM121 GB10 stack . Thanks
@jarrelscy for the quantization/vllm sm120
Now you can run the MiMo V2.6 PRO-RL on TP=4 on 4 DGX sparks with 1M context and 2M KV token pool
Dflash and Ablit coming for this. Stay tuned