netrunner
@plotarmordev
Cofounder & engineer.
Running local AI, building things with it, and sharing what I learn.
加入 April 2022
806 正在關注 8.4K 粉絲
GLM-5.3 on 8 DGX Sparks: about 44 tok/s with @ashxhart's TensorFold, 26 with vLLM, and over twice the context.
Not really the same weights though, each side compressed the model its own way. Nice run by @ciprianveg!
顯示更多
