註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Horace He
@cHHillee
@thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
加入 February 2010
633 正在關注    55.4K 粉絲
There's an interesting distortion in inference pricing that appears to be driven by openrouter's routing. Namely, ridiculously cheap prefill and very expensive decode. For GLM 5.3, (highest volume provider) charges $0.08/M input but $5.00/M output!(1/5)
顯示更多
Guys, did you see the inference price war for open weight models in openrouter? It’s bloody war to compete on the lowest price. Reminds me of electricity. I keep hearing inference is huge margin but then it seems it’s a war to zero at openrouter nowadays. I finally understand why openrouter charges 5.5%. I keep hearing stories of data centers in Finland, Philippines and Southeast Asia that are just cheap, cheaper and cheapest? I wonder how US neoclouds cope with this? I mean enterprise is a good market I’m sure.
顯示更多
0
49
636
38
轉發到社區