Tencent Hy
@TencentHunyuan
Tencent's foundation model for text, image, video, and 3D generation.
加入 July 2024
8 正在關注 46.5K 粉絲
🚀 We’ve open-sourced AngelSpec, an end-to-end speculative decoding framework supporting both training and deployment.
On Hy3-A21B, DFly delivers a 1.98–2.40× end-to-end speedup over autoregressive decoding across tested concurrency levels from 4 to 64, with 10.5–11.8% higher throughput than DFlash.
Training code and Hy3-A21B MTP/DFly drafter weights are now available:
GitHub:
Paper:
Docs:
Hugging Face:
ModelScope:
#Hy3# #AngelSpec# #OpenSource#
顯示更多
