注册并分享邀请链接,可获得视频播放与邀请奖励。

AI Highlight
@AIHighlight
Al and Tech move fast, we highlight what matters || Curating the most important breakthroughs and tools in Al l DM for collaborations 📩 hello@aihighlight.io
加入 March 2012
791 正在关注    625.9K 粉丝
Three AI inference methods went head-to-head, and EAGLE-4 came out ahead in the reported test. Its launch paper shows 961.6 tokens per second for EAGLE-4, compared to 672.6 for DFlash 2 and 618.6 for DSpark on four NVIDIA B300 GPUs. That's roughly 1.43x and 1.55x their throughput, respectively, showing what its improved token prediction method can deliver under the same benchmark conditions. The numbers are worth a closer look. Explore the full benchmarks and GitHub repository:
显示更多
EAGLE-4 is here. From EAGLE-1 to EAGLE-3, we’ve kept making inference faster. EAGLE-4 is our fastest yet. 961.6 tokens/s on @Alibaba_Qwen’s Qwen3.8-27B with TokenSpeed (BF16, 4× @NVIDIA B300, TP4, one request, T=0). Github:
显示更多
0
3
27
27
转发到社区