coding agents resend the whole conversation on every turn. prefix caching keeps long sessions fast, but only if the harness and the inference engine both do their part.
@zainhas from Together and
@parthsareen from
@ollama wrote down what each side needs to get right.