註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

steve hsu
@hsu_steve
Physicist, AI Founder, Manifold Podcast
加入 June 2010
0 正在關注    46.8K 粉絲
DeepSeek: "...open-sourcing the infrastructure components for Huawei's Ascend computing platform, including the TileLang high-level language compiler, computing libraries, and distributed communication libraries. All components correspond one-to-one with the previously open-source components for the NVIDIA platform. TileLang has already been validated on NVIDIA platforms and currently powers the majority of the operators used in training DeepSeek’s state-of-the-art V4 series models." Qwen says: Currently, DeepSeek uses a hybrid training strategy: NVIDIA for the massive 33T token pre-training phase, and Huawei Ascend for post-training (RLHF/SFT) and inference. However, with DeepSeek recently ordering 160,000 next-generation Ascend 950DT/960 chips, the company is building the infrastructure to move pre-training to Ascend by 2027, once the new chips support the necessary low-precision (FP4) training formats.
顯示更多