Lysandre
@LysandreJik
Chief Open-Source Officer (COSO) at Hugging Face
Joined March 2019
647 Following 12.5K Followers
Great to see inference engines starting to leverage kernels on the Hub, in this case sglang.
It's probably the easiest and fastest way to install flash attention and other specialized kernels right now.
Show more
