benchmarks of a 50% pruned Qwen3.6-35b-a3b and expert-specific quantization technique (made by me)
7.3gb model preforming => 51gb model, exiting to see where I can bring this technique to. I have some more things lined up too.
I need a DGX spark😭
Had some pushback on the new auto-prune after 90days on sessions, found a better solution.
Pruning will be off by default, but on new sessions will do a 2microsecond check to see if your db is about to eat all your storage, and then prompt you to prune or manage it yourself.
Enjoy :)
Minimax H3 🙂 SOL fl2va pruned
By comfyanonymous
-forces the model's Query/Key/Value (Q/K/V) tensors to pipe through the optimized Sol-Attn backend
-cuts down generation time and lets you render video/audio blocks much faster per second of video gen
👇
Kijai's 😃
Minimax_h3_ref2va_pruned_w6a8_g32
its experimental, highly quantized work-in-progress (WIP) base model for MiniMax H3 video generation. It is a massive 16.8 GB file designed to drastically reduce the VRAM required to run this model locally.
👇
Vietnam's capital Hanoi has launched a large-scale program to prune hundreds of its iconic blackboard trees and is considering relocating some after their distinctive fragrance proved too much for some residents
gmancer! i pruned our node last night which resulted in a temporary performance decline while it was being pruned. it is done and performance will go back to normal in just a moment. i will also do this differently going forward so there is no impact on performance.
Kijai's 😃
Minimax H3 4step_lora_flashgen_v1.0 768p_fl2va_pruned_avg_rank_13_bf16
This Lora is a Turbo/Flash acceleration adapter. using only 4 steps, delivering a roughly 5x speedup in generation times
👇