A new dense 32B model ran a 239K-token conversation inside a 16GB GPU-memory budget.
Agens Volundr 32B v1 compares well to Qwen3.8-27B.
And the trick isn't just the ~2.8-bit quant.
54 of its 72 layers don't build a growing KV cache at all. đ
Blockway released Agens Volundr 32B v1 today.
Stats
đ§ 32B parameters
đ 262K configured context
đž ~2.82 bits/weight on the 16GB build
đ Apache 2.0 weights
âī¸ MIT-licensed Agens Engine
đĻ Official GGUFs already available
Special Source đ instead of every layer accumulating KV as context grows
72 layers
â
54 keep fixed-size recurrent state
â
only 18 layers maintain growing KV cache
That helps with long-context memory
Using Agens Engine's hard 16 GiB GPU-memory cap, Blockway fed it a 219K-token document and reports at T=0.6
⥠Chat â 57 tps
⥠Code â 79 tps
⥠Thinking â 71 tps
⥠Tool calls â 67 tps
They pushed the limits of the 239K-token envelope while GPU memory peaked around 15.5 GiB.
At short context, the same profile reaches roughly 86â123 tps depending on workload.
And there's already a separate 24GB profile using the 4-bit weights for cards in the RTX 4090 class.
đ¯ Volundr attacks the other monster in the room, : the memory cost of long context.
â ī¸ Those published 16GB and 24GB performance numbers were measured on a 48GB GPU running under hard memory caps, not yet on physical 16GB/24GB consumer cards.
The official GGUFs work today with Blockway's llama.cpp fork.
Stock llama.cpp support is still being upstreamed.
Link in ALT