注册并分享邀请链接,可获得视频播放与邀请奖励。

Horace He
@cHHillee
@thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
加入 February 2010
633 正在关注    55.4K 粉丝
Also, their cache hits are nearly as expensive as their cache misses! From a GPU efficiency perspective, this makes no sense. Prefill is more efficient than decode, but it's not 60x more efficient! I suspect the reason is due to two subtleties in openrouter routing. (2/5)
显示更多