๐ Weโve open-sourced AngelSpec, an end-to-end speculative decoding framework supporting both training and deployment.
On Hy3-A21B, DFly delivers a 1.98โ2.40ร end-to-end speedup over autoregressive decoding across tested concurrency levels from 4 to 64, with 10.5โ11.8% higher throughput than DFlash.
Training code and Hy3-A21B MTP/DFly drafter weights are now available:
GitHub:
Paper:
Docs:
Hugging Face:
ModelScope:
#
Hy3# #
AngelSpec# #
OpenSource#