netrunner
@plotarmordev
Cofounder & engineer.
Running local AI, building things with it, and sharing what I learn.
Joined April 2022
806 Following 8.4K Followers
GLM-5.3 on 8 DGX Sparks: about 44 tok/s with @ashxhart's TensorFold, 26 with vLLM, and over twice the context.
Not really the same weights though, each side compressed the model its own way. Nice run by @ciprianveg!
Show more
