Horace He
@cHHillee
Joined February 2010
633 Following 55.4K Followers
There's an interesting distortion in inference pricing that appears to be driven by openrouter's routing.
Namely, ridiculously cheap prefill and very expensive decode. For GLM 5.3, (highest volume provider) charges $0.08/M input but $5.00/M output!(1/5)
Show more
Guys, did you see the inference price war for open weight models in openrouter? It’s bloody war to compete on the lowest price. Reminds me of electricity.
I keep hearing inference is huge margin but then it seems it’s a war to zero at openrouter nowadays. I finally understand why openrouter charges 5.5%.
I keep hearing stories of data centers in Finland, Philippines and Southeast Asia that are just cheap, cheaper and cheapest?
I wonder how US neoclouds cope with this? I mean enterprise is a good market I’m sure.
Show more
