netrunner(@plotarmordev):The last update already beat what we promised for some setups, and more is coming! I'm testing the next one now: swap during model load will likely be lowered by over 90%, and long-prompt cache reuse will work better too. Results as soon as validation ends 👀

netrunner

@plotarmordev

Cofounder & engineer. Running local AI, building things with it, and sharing what I learn.

Joined April 2022

675 Following 7.1K Followers

netrunner@plotarmordev

2026.09.24 02:40

The last update already beat what we promised for some setups, and more is coming! I'm testing the next one now: swap during model load will likely be lowered by over 90%, and long-prompt cache reuse will work better too. Results as soon as validation ends 👀