가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Kush Bavaria
@bavaria_kush
helping finance compute @ornnexchange | CS @MIT
가입 February 2022
397 팔로잉 중    2.4K 팬
Today, the @OrnnExchange team published a research paper on The Economics of Open-Weight Inference. We measure cost per completed task across eleven open-weight and eight closed models, the cost of a million output tokens on rented @NVIDIA A100 through B200, and rental term prices from one month to five years. On the same model, the A100 can produce a million output tokens for less than half the cost of an H100. A new GPU generation does not make its predecessor economically obsolete. GPU financing is changing.
더 보기
Even the oldest GPUs might have a longer useful life than 6 years. Our team published a paper, The Economics of Open-Weight Inference which asks whether a new NVIDIA generation makes the previous one economically obsolete. 🧵
더 보기