Armin Ronacher ⇌(@mitsuhiko):We've recently made Pi's cache behavior more visible. This site has been debating whether agent harnesses are helping or quietly torching their caches. That seemed like a good excuse to explain how KV caches actually work and how Pi helps (or doesn't).

Armin Ronacher ⇌

@mitsuhiko

Creator of Flask. Building at Bypassing Permissions. Can hand crank. Husband and father of 3 — “more nuanced in person”

Joined February 2008

903 Following 84.1K Followers

Armin Ronacher ⇌@mitsuhiko

2026.07.23 10:47

We've recently made Pi's cache behavior more visible. This site has been debating whether agent harnesses are helping or quietly torching their caches. That seemed like a good excuse to explain how KV caches actually work and how Pi helps (or doesn't).