stevibe(@stevibe):2.3x faster. Ran @UnslothAI Qwen3.6 MTP variants on a DGX Spark (UD-Q6_K_XL): &gt; 27B → 27B MTP: 8.1 → 18.65 t/s (2.3x faster) &gt; 35B A3B → 35B A3B MTP: 56.91 → 66.52 t/s (+17%) The 27B dense model more than doubled throughput from MTP alone. Free speed is free speed.

stevibe

@stevibe

LLM. Local AI addict. Building @BenchLocalAI Builds things nobody asked for. Benchmarks things for fun.

가입 July 2009

1.3K 팔로잉 중 27.7K 팬

stevibe@stevibe

2026.05.13 17:14

2.3x faster. Ran @UnslothAI Qwen3.6 MTP variants on a DGX Spark (UD-Q6_K_XL): > 27B → 27B MTP: 8.1 → 18.65 t/s (2.3x faster) > 35B A3B → 35B A3B MTP: 56.91 → 66.52 t/s (+17%) The 27B dense model more than doubled throughput from MTP alone. Free speed is free speed.