註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

NVIDIA AI Infrastructure
@NVIDIAAIInfra
AI factories for the era of AI reasoning.
加入 November 2009
1.7K 正在關注    78.5K 粉絲
Shopee just published the results of building its own frontier LLM, which now powers use cases from search and personalization to supply chain. Compass, Shopee's specialized model for Southeast Asian ecommerce, scaled from 3 billion to 340 billion monthly API tokens in eight months on our AI factory stack. It includes NVIDIA Megatron-Core for pretraining, NVIDIA NeMo framework for post-training, and TensorRT-LLM for inference, running across NVIDIA A100, H100, and RTX PRO 6000 Blackwell GPUs. Results: ✅ Compass API tokens scale 113x in eight months ✅ 50x faster fraud detection at 90% lower processing cost Read the customer story.
顯示更多
0
6
96
12
轉發到社區