註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

AI Highlight
@AIHighlight
Al and Tech move fast, we highlight what matters || Curating the most important breakthroughs and tools in Al l DM for collaborations 📩 hello@aihighlight.io
加入 March 2012
791 正在關注    625.9K 粉絲
Three AI inference methods went head-to-head, and EAGLE-4 came out ahead in the reported test. Its launch paper shows 961.6 tokens per second for EAGLE-4, compared to 672.6 for DFlash 2 and 618.6 for DSpark on four NVIDIA B300 GPUs. That's roughly 1.43x and 1.55x their throughput, respectively, showing what its improved token prediction method can deliver under the same benchmark conditions. The numbers are worth a closer look. Explore the full benchmarks and GitHub repository:
顯示更多
EAGLE-4 is here. From EAGLE-1 to EAGLE-3, we’ve kept making inference faster. EAGLE-4 is our fastest yet. 961.6 tokens/s on @Alibaba_Qwen’s Qwen3.8-27B with TokenSpeed (BF16, 4× @NVIDIA B300, TP4, one request, T=0). Github:
顯示更多
0
3
27
27
轉發到社區