注册并分享邀请链接,可获得视频播放与邀请奖励。

Silicon Atlas
@Silicon_Atlas
Evidence-first AI semiconductor analysis: what new silicon claims prove, where bottlenecks move, and whether gains survive at system and economic scale.
加入 March 2021
123 正在关注    2.9K 粉丝
An AI energy forecast has to connect workload demand to the whole system that serves it. NVIDIA's DSX framing brings compute, power, and cooling into that picture. Start with the model, input/output lengths, concurrent requests, and response-time targets. Those conditions shape GPU energy per output token. Then account for how the fleet is used over time, the rest of the IT equipment, and cooling. A site's power cap sets its ceiling; actual energy consumption depends on how that system runs. The useful forecasting question is: how much energy will this workload require across the system that serves it?
显示更多
AI factory efficiency takes a full-system approach. The NVIDIA DSX AI factory platform brings compute, power, cooling, and grid flexibility together to make the entire AI factory more efficient and generate greater AI output from available energy.
显示更多