Register and share your invite link to earn from video plays and referrals.

Kush Bavaria
@bavaria_kush
helping finance compute @ornnexchange | CS @MIT
Joined February 2022
397 Following    2.4K Followers
Today, the @OrnnExchange team published a research paper on The Economics of Open-Weight Inference. We measure cost per completed task across eleven open-weight and eight closed models, the cost of a million output tokens on rented @NVIDIA A100 through B200, and rental term prices from one month to five years. On the same model, the A100 can produce a million output tokens for less than half the cost of an H100. A new GPU generation does not make its predecessor economically obsolete. GPU financing is changing.
Show more
Even the oldest GPUs might have a longer useful life than 6 years. Our team published a paper, The Economics of Open-Weight Inference which asks whether a new NVIDIA generation makes the previous one economically obsolete. 🧵
Show more