注册并分享邀请链接,可获得视频播放与邀请奖励。

Kush Bavaria
@bavaria_kush
helping finance compute @ornnexchange | CS @MIT
加入 February 2022
397 正在关注    2.4K 粉丝
Today, the @OrnnExchange team published a research paper on The Economics of Open-Weight Inference. We measure cost per completed task across eleven open-weight and eight closed models, the cost of a million output tokens on rented @NVIDIA A100 through B200, and rental term prices from one month to five years. On the same model, the A100 can produce a million output tokens for less than half the cost of an H100. A new GPU generation does not make its predecessor economically obsolete. GPU financing is changing.
显示更多
Even the oldest GPUs might have a longer useful life than 6 years. Our team published a paper, The Economics of Open-Weight Inference which asks whether a new NVIDIA generation makes the previous one economically obsolete. 🧵
显示更多