netrunner
@plotarmordev
Cofounder & engineer.
Running local AI, building things with it, and sharing what I learn.
加入 April 2022
675 正在关注 7.1K 粉丝
The last update already beat what we promised for some setups, and more is coming!
I'm testing the next one now: swap during model load will likely be lowered by over 90%, and long-prompt cache reuse will work better too.
Results as soon as validation ends 👀
显示更多
