Joe Barrow
@barrowjoseph
NLP + Machine Learning
Prev: NLP Researcher @AdobeResearch, PhD @ClipUmd.
加入 December 2012
517 正在关注 5K 粉丝
Good engineering is about observability.
Speculative decoding accelerates LLM inference, but you're running it blind. Every rejected draft token is wasted compute, but are you looking at the drafts?
This weekend I wrote specspecs to solve that!
显示更多
