netrunner
@plotarmordev
Cofounder & engineer.
Running local AI, building things with it, and sharing what I learn.
参加 April 2022
806 フォロー中 8.4K ファン
GLM-5.3 on 8 DGX Sparks: about 44 tok/s with @ashxhart's TensorFold, 26 with vLLM, and over twice the context.
Not really the same weights though, each side compressed the model its own way. Nice run by @ciprianveg!
もっと見る
