Register and share your invite link to earn from video plays and referrals.

Wësche
@WescheNex1q
Day time artist and night time AI enthusiast. Building & benchmarking frontier LLMs on 4x DGX Spark clusters + Mac. Creator of Vesica Studio. Houston
Joined January 2013
731 Following    3.1K Followers
GLM-5.3 753b went from 70.8 to 84.4 on Spark-Bench by changing the quant. @ViC305's SAGE MixedK 3.38bpw, 4x DGX Spark, TensorFold TP4 + DFlash2. Vs the 2.75bpw run: +13.6 points. 80 tests, 2 repeats, thinking off, uncapped. O errors. GLM-5.3 full scored 70.5 on our long-output builds, the best of any model we've tested. GLM-5.3-Flash got 42.1. Overall 84.4 on 4x DGX Spark Reliability (both repeats pass), Full vs Flash Code: 75.7 vs 90.0. Robustness: 75.0 vs 50.0. Long output: 89.2 vs 56.2. Agentic: 88.0 vs 83.3. Visual: 82.0 vs 84.2
Show more
🚀 FULL GLM-5.3. FOUR DGX SPARKS. A NEW PARETO-FRONTIER CONTENDER. This is a HUGE personal milestone for my SAGE work! 🔥 My GLM-5.3 SAGE EXL3 3.38 bpw brings the full model down to 319 GB while preserving ALL 19,200 routed experts. No pruning. No expert merging. Every bit matters. 🎯 INDEPENDENT-SET FIDELITY • KL divergence: 0.082388 nats • BF16 top-1 agreement: 91.1523% • 10,240 scored positions on text excluded from calibration ⚡ FOUR-SPARK PERFORMANCE Around 41 tok/s average (69 tok/s burst) across six real prompts with DFlash2, with drafted replies matching serial decoding token for token. 256K-context serving demonstrated. Sized toward a 1M-context memory target, with full-length inference validation still ahead. The goal is the highest-fidelity full GLM-5.3 possible on four Sparks WITHOUT sacrificing the memory needed for 256K–1M context. Not just making the weights fit, but leaving room to actually USE the model. 🙏 A MASSIVE thank you to @cfontes, who personally funded the compute required to make this model possible. This release would not have happened without his support! And we’re not done. He’ll be releasing a recipe soon that’s going to blow everyone’s minds! 🤯🔥 This is what community-backed local AI looks like. More capability, less memory, and people coming together to push what’s possible. 💪 Model 👇
Show more