注册并分享邀请链接,可获得视频播放与邀请奖励。

Horace He
@cHHillee
@thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
加入 February 2010
633 正在关注    55.4K 粉丝
There's an interesting distortion in inference pricing that appears to be driven by openrouter's routing. Namely, ridiculously cheap prefill and very expensive decode. For GLM 5.3, (highest volume provider) charges $0.08/M input but $5.00/M output!(1/5)
显示更多
Guys, did you see the inference price war for open weight models in openrouter? It’s bloody war to compete on the lowest price. Reminds me of electricity. I keep hearing inference is huge margin but then it seems it’s a war to zero at openrouter nowadays. I finally understand why openrouter charges 5.5%. I keep hearing stories of data centers in Finland, Philippines and Southeast Asia that are just cheap, cheaper and cheapest? I wonder how US neoclouds cope with this? I mean enterprise is a good market I’m sure.
显示更多
0
49
636
38
转发到社区