netrunner
@plotarmordev
Cofounder & engineer.
Running local AI, building things with it, and sharing what I learn.
가입 April 2022
806 팔로잉 중 8.4K 팬
GLM-5.3 on 8 DGX Sparks: about 44 tok/s with @ashxhart's TensorFold, 26 with vLLM, and over twice the context.
Not really the same weights though, each side compressed the model its own way. Nice run by @ciprianveg!
더 보기
