Register and share your invite link to earn from video plays and referrals.

Shantanu Goel
@shantanugoel
Engineering @TheTradeDesk / @Google / @Qualcomm ❤️Tinkering with 3D Printing / Electronics / HW / Rust / AI
Joined April 2008
744 Following    17.3K Followers
All the mainstream news is covered by major labs' models. But what goes unreported is the work by community on getting these to run on much lower hardware and much faster. Many of us know about llama.cpp/sglang/vllm et al. Still fewer know about @turboderp_ 's exl3 and exllamav3, @ashxhart 's Tensorfold, and now @mmastrac @coffeedev @CK2084 's work on exlr8 and these are just a few of these examples which are playing as big a role as any in AI.
Show more