Joe Barrow
@barrowjoseph
NLP + Machine Learning
Prev: NLP Researcher @AdobeResearch, PhD @ClipUmd.
参加 December 2012
517 フォロー中 5K ファン
Good engineering is about observability.
Speculative decoding accelerates LLM inference, but you're running it blind. Every rejected draft token is wasted compute, but are you looking at the drafts?
This weekend I wrote specspecs to solve that!
もっと見る
