가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

steve hsu
@hsu_steve
Physicist, AI Founder, Manifold Podcast
가입 June 2010
0 팔로잉 중    46.8K 팬
DeepSeek: "...open-sourcing the infrastructure components for Huawei's Ascend computing platform, including the TileLang high-level language compiler, computing libraries, and distributed communication libraries. All components correspond one-to-one with the previously open-source components for the NVIDIA platform. TileLang has already been validated on NVIDIA platforms and currently powers the majority of the operators used in training DeepSeek’s state-of-the-art V4 series models." Qwen says: Currently, DeepSeek uses a hybrid training strategy: NVIDIA for the massive 33T token pre-training phase, and Huawei Ascend for post-training (RLHF/SFT) and inference. However, with DeepSeek recently ordering 160,000 next-generation Ascend 950DT/960 chips, the company is building the infrastructure to move pre-training to Ascend by 2027, once the new chips support the necessary low-precision (FP4) training formats.
더 보기