netrunner
@plotarmordev
Cofounder & engineer.
Running local AI, building things with it, and sharing what I learn.
๊ฐ์
April 2022
675 ํ๋ก์ ์ค 7.1K ํฌ
The last update already beat what we promised for some setups, and more is coming!
I'm testing the next one now: swap during model load will likely be lowered by over 90%, and long-prompt cache reuse will work better too.
Results as soon as validation ends ๐
๋ ๋ณด๊ธฐ
