Introducing Full GLM-5.3 on 4x RTX PRO 6000: recipe 1.0.0 with TensorFold v0.6.5 🔥 4x RTX PRO 6000 (250 W per GPU): - 92 tok/s on prose, single stream - 140 tok/s on prose, 5 concurrent streams - 195 tok/s on structured output, 5 concurrent streams - Prefill up to 2,081 tok/s - Next turn in a 130K-token conversation: 4.14 s to first token - Up to 5 concurrent requests, 1M context What's new: - TensorFold v0.6.5 with 151 engine patches: 106 ported from the original full GLM-5.3 recipe, 45 of ours - Five concurrent sessions with context parallelism over one 1,245,184-token FP8 KV pool - RAM and NVMe prompt tiers: a 747,292-token prompt resumes in 4.07 s from RAM - Teacher KL 0.0468 with FP8 dense and FP8 KV, lower than the 0.0568 of our earlier build - One command: ./start.sh builds, downloads and serves Special thanks to @MiaAI_lab for the EXL3 checkpoint and base patches, and to @ashxhart for TensorFold!