가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Horace He
@cHHillee
@thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
가입 February 2010
633 팔로잉 중    55.4K 팬
There's an interesting distortion in inference pricing that appears to be driven by openrouter's routing. Namely, ridiculously cheap prefill and very expensive decode. For GLM 5.3, (highest volume provider) charges $0.08/M input but $5.00/M output!(1/5)
더 보기
Guys, did you see the inference price war for open weight models in openrouter? It’s bloody war to compete on the lowest price. Reminds me of electricity. I keep hearing inference is huge margin but then it seems it’s a war to zero at openrouter nowadays. I finally understand why openrouter charges 5.5%. I keep hearing stories of data centers in Finland, Philippines and Southeast Asia that are just cheap, cheaper and cheapest? I wonder how US neoclouds cope with this? I mean enterprise is a good market I’m sure.
더 보기