netrunner(@plotarmordev):LOCAL AI TECH TIP: If you see issues with slow agent turns, check whether its prompt cache survives between turns. AND if you're testing a possible prompt cache fix, compare runtime versions with the same checkpoint, quant and prompts. Measure the first turn separately from follow-ups that reuse the same prefix.

netrunner

@plotarmordev

Cofounder & engineer. Running local AI, building things with it, and sharing what I learn.

加入 April 2022

782 正在关注 8.2K 粉丝

netrunner@plotarmordev

2026.10.06 13:01

LOCAL AI TECH TIP: If you see issues with slow agent turns, check whether its prompt cache survives between turns. AND if you're testing a possible prompt cache fix, compare runtime versions with the same checkpoint, quant and prompts. Measure the first turn separately from follow-ups that reuse the same prefix.

显示更多