註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Shantanu Goel
@shantanugoel
Engineering @TheTradeDesk / @Google / @Qualcomm ❤️Tinkering with 3D Printing / Electronics / HW / Rust / AI
加入 April 2008
744 正在關注    17.3K 粉絲
All the mainstream news is covered by major labs' models. But what goes unreported is the work by community on getting these to run on much lower hardware and much faster. Many of us know about llama.cpp/sglang/vllm et al. Still fewer know about @turboderp_ 's exl3 and exllamav3, @ashxhart 's Tensorfold, and now @mmastrac @coffeedev @CK2084 's work on exlr8 and these are just a few of these examples which are playing as big a role as any in AI.
顯示更多