Tech2Wild(@Tech2Wild):Ran TensorFold (EXL3) against my own vLLM TP2 recipe, same prompts: ⚡ Code 82 vs 69 tok/s ⚡ JSON 84 vs 71 ⚡ Prose 44 vs 35 📈 Mixed load at C4: 108 vs 72 tok/s (+51%) 🚀 Prefill 1,781 vs 1,225 tok/s 🧠 500K context vs 262K Two boxes on a desk 🤯 https://t.co/0NBRF5tfxl

Tech2Wild

@Tech2Wild

🎮 Tech, gaming, AI, and everything in between. 🤖 Building with it, not just talking about it. 🔥 From the mind of @ToNYD2WiLD

加入 March 2026

222 正在關注 4.8K 粉絲

Tech2Wild@Tech2Wild

2026.10.12 01:30

Ran TensorFold (EXL3) against my own vLLM TP2 recipe, same prompts: ⚡ Code 82 vs 69 tok/s ⚡ JSON 84 vs 71 ⚡ Prose 44 vs 35 📈 Mixed load at C4: 108 vs 72 tok/s (+51%) 🚀 Prefill 1,781 vs 1,225 tok/s 🧠 500K context vs 262K Two boxes on a desk 🤯