가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Caleb Eom
@calebfoundry
over-analyze everything.
가입 March 2025
207 팔로잉 중    2.3K 팬
so I was bored and did some math on Ox Alpha being offered for free for a week - seemed insane to give away 100T tokens per day for an entire week for free.. Ox Alpha at full capacity is giving away $1-$2M in electricity alone at around 100MW of Hopper grade data center for public use. (assuming $0.07 - $0.14/kWh). that's a lot of money just to get people to try it.. now, so far the aggregate usage for the day is still only 5% capacity combining usage data from Open Router and Open Code usage. and based on OR page, Ox Alpha is offering averaging around 26TPS, and about 98% of tokens are input tokens with 87% cache hit and 1.3% are output tokens. which means the current use case would only generate 161M fresh tokens per second, or ~14T tokens per day discounting cached inputs during prefill. so if whoever's hosting this model (crazier if it's China) meant they can GENERATE 100T/day, the number looks even bigger at 7-8GW of data center, but they probably meant harmonized input+output tokens not JUST output tokens only. finally many people on X are assuming this is GLM 5.x model - and their 5.3 model was ~744B param and 40B active - so supporting this sized model at full capacity would require at least 72,000 H200 GPU serving ~500,000+ concurrent users at 26TPS. happy to hear people's thoughts on this..
더 보기