netrunner(@plotarmordev):The last update already beat what we promised for some setups, and more is coming! I'm testing the next one now: swap during model load will likely be lowered by over 90%, and long-prompt cache reuse will work better too. Results as soon as validation ends 👀

netrunner

@plotarmordev

Cofounder & engineer. Running local AI, building things with it, and sharing what I learn.

加入 April 2022

675 正在關注 7.1K 粉絲

netrunner@plotarmordev

2026.09.24 02:40

The last update already beat what we promised for some setups, and more is coming! I'm testing the next one now: swap during model load will likely be lowered by over 90%, and long-prompt cache reuse will work better too. Results as soon as validation ends 👀