註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Horace He
@cHHillee
@thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
加入 February 2010
633 正在關注    55.4K 粉絲
If you look at the actual share of input/output tokens though, it's ~6:1. Perhaps openrouter is assuming a far lower cache hit ratio than is true in practice. Either way, it's an interesting case of the router dynamics distorting the natural pricing for the inference providers! I apologize to companies currently exploiting this if I'm giving away valuable alpha :^) (5/5)
顯示更多