๐พ Smaller KV cache. Bigger savings.
Compared with the previous generation, V4.1-Flashโs KV cache needs just:
๐น 1/4 the HBM
๐น 1/8 the SSD storage
Cache-hit charges often account for a large share of agent costs. Compressing the cache cuts those costs significantly.
3/6