Register and share your invite link to earn from video plays and referrals.

Leroy Li
@LeroyLi311063
Just my thoughts
Joined July 2025
33 Following    888 Followers
Deployment of DeepSeek-V4.1-Flash using FP8-FP4 mixed on 32 Ascend 950DT. For 128K sequence scenarios, single-card decoding throughput reaches 5,800 TPS at 13.79 ms. In low-latency inference scenarios, latency is kept under 5 ms while achieving a throughput of 2,727.
Show more