Brett Harrison(@BrettHarrison):The Compute Desk Nvidia B300 GPU-hour index is at its all-time high. As margins on training grow thinner, neoclouds are collectively shifting focus to inference. High-priced B300s are generating ROI by lowering the marginal cost per token generated through batch inference.

Brett Harrison

@BrettHarrison

Founder & CEO @Architect_Fi, ex-Citadel Securities/Jane Street, dev, dad

加入 May 2021

3.5K 正在關注 71K 粉絲

Brett Harrison@BrettHarrison

2026.08.06 13:51

The Compute Desk Nvidia B300 GPU-hour index is at its all-time high. As margins on training grow thinner, neoclouds are collectively shifting focus to inference. High-priced B300s are generating ROI by lowering the marginal cost per token generated through batch inference.