注册并分享邀请链接,可获得视频播放与邀请奖励。

Horace He
@cHHillee
@thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
加入 February 2010
633 正在关注    55.4K 粉丝
If you look at the actual share of input/output tokens though, it's ~6:1. Perhaps openrouter is assuming a far lower cache hit ratio than is true in practice. Either way, it's an interesting case of the router dynamics distorting the natural pricing for the inference providers! I apologize to companies currently exploiting this if I'm giving away valuable alpha :^) (5/5)
显示更多