注册并分享邀请链接,可获得视频播放与邀请奖励。

Shantanu Goel
@shantanugoel
Engineering @TheTradeDesk / @Google / @Qualcomm ❤️Tinkering with 3D Printing / Electronics / HW / Rust / AI
加入 April 2008
744 正在关注    17.3K 粉丝
All the mainstream news is covered by major labs' models. But what goes unreported is the work by community on getting these to run on much lower hardware and much faster. Many of us know about llama.cpp/sglang/vllm et al. Still fewer know about @turboderp_ 's exl3 and exllamav3, @ashxhart 's Tensorfold, and now @mmastrac @coffeedev @CK2084 's work on exlr8 and these are just a few of these examples which are playing as big a role as any in AI.
显示更多