가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Sonnet Xu
@sonnet_xu
cs @ stanford || reliability + benchmarking, compute + llms
가입 January 2025
89 팔로잉 중    1.3K 팬
inference is becoming a market-making business upstream, GPU capacity is bought in chunks: financed, contracted, take-or-pay, multi-year downstream, tokens are bought on demand warehousing the mismatch between the two means forecasting demand, absorbing idle capacity, and repricing compute into tokens neoclouds are moving down into inference and inference providers are moving up into GPUs whoever can make a market between fixed capacity and variable demand takes the spread
더 보기