Kimi K3 exposed the real bottleneck in open AI: open weights do not mean easy inference.
Moonshot paused new subscriptions as demand overwhelmed capacity, and recommends 64+ accelerator supernodes for K3.
This also sheds light on what the model-serving ecosystem may look like once K3 releases its weights. It turns out we already have a thriving industry:
@FireworksAI_HQ ,
@baseten and
@togethercompute carry $38.8B in combined valuations, with revenue, bookings and token volumes growing rapidly.