inference companies are taking on a lot of risk right now they're signing longer contracts for compute because they never want to have customers and run out of compute at the same time. it'd be a big problem if users are growing, but they have to pause the product it's hard to get compute fairly right now, so this is all they can do. inference companies are in a particularly tough spot because they work on a pay-as-you-go model, where customers pay per token and can leave whenever. clearly, this is a problem when you buy gpus on fixed contracts, because you'll pay for them even if customers don't use them inference companies are simply stuck with no other choice. changing the way compute is bought will also make inference better!