netrunner
@plotarmordev
Cofounder & engineer.
Running local AI, building things with it, and sharing what I learn.
加入 April 2022
806 正在关注 8.4K 粉丝
NVIDIA's Nemotron 3.5 Bolt soon to run natively on a Windows laptop. On battery!!
It's TensorFold on an RTX Spark N1X. Add @MiaAI_lab's recipe and NVIDIA's LiLiCorr drafter, and code comes out up to 2.8x faster, at 100 tok/s.
My port and a bug fix are up as PRs. Links below
显示更多
