Horace He(@cHHillee):If you look at the actual share of input/output tokens though, it's ~6:1. Perhaps openrouter is assuming a far lower cache hit ratio than is true in practice. Either way, it's an interesting case of the router dynamics distorting the natural pricing for the inference providers! I apologize to companies currently exploiting this if I'm giving away valuable alpha :^) (5/5)

Horace He

@cHHillee

@thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale

가입 February 2010

633 팔로잉 중 55.4K 팬

Horace He@cHHillee

2026.10.05 00:32

If you look at the actual share of input/output tokens though, it's ~6:1. Perhaps openrouter is assuming a far lower cache hit ratio than is true in practice. Either way, it's an interesting case of the router dynamics distorting the natural pricing for the inference providers! I apologize to companies currently exploiting this if I'm giving away valuable alpha :^) (5/5)