Slurm: 2002, the bare metal era. Kubernetes: 2014, the container era. Different eras, different jobs. Mike Petersen on why, and how to run Slurm on Kubernetes. New AI Lab →

Compute infra feels a lot like the early crypto days. From bare metal to hardware financing, data center construction, chips, cooling, power procurement, grid interconnection, and state by state energy permitting. Then networking, Gpu/tpu utilization, workload scheduling, and inference optimization. And finally compute markets via onchain, trading infra, financing, pricing oracles, and verification that the compute you bought actually gets delivered. Hair on fire problems in almost every part of the stack. Pretty exciting times.

JPM on Neoclouds: "Across the industry, longer-term bare metal pricing seems to be around $10-12/W...We believe achieving $15/W+ pricing on bare metal (or bare metal adjacent) deals involves having access to near-term capacity and high-end GPUs with shorter contract terms and low customer prepayments, if at all. While SpaceXAI was able to sign $30-50/W deals, we believe most high end deals for neocloud providers will be in the $15-20/W+ range given pricing comments made by CRWV, $NBIS, and $IREN. The higher end is achieved through shorter contract duration and smaller customer pre-payments. Additionally, industry commentary about the resiliency of GPUs once they are past burn-in testing and $CRWV recent comment about signing A100s point to GPU useful lifespans being longer than current estimates of ~5-6 years. With the primary operating costs for the neocloud business being power and GPU depreciation, an elongation in useful life represents a meaningful uplift in profitability."

A round of applause for our #PyTorchCon# North America diamond sponsor Google. From bare metal infrastructure to agent based systems, it's all on the agenda in San Jose, CA on October 20-21. Learn more: