註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Tiezhen WANG
@Xianbao_QIAN
Helping ecosystem to grow on vLLM, ex-Head of APAC ecosystem @huggingface. Ex-Googler on TFLite/micro. Ideas on my own. Interested in future tech. DM open
加入 November 2022
2.9K 正在關注    12.9K 粉絲
You might have not understand what this means. If this is true, and DS-v4-Pro is open sourced, then gg Opus or even Fable 😅 This means that DS is able to offer Fable level model at 1/50 API price with a much higher cache hit rate compared to Anthropic, thanks to DS v4's ultra small sparse KV Cache. The total cost might be 1/100 lower while the model capability is pretty much the same. Bullish for storage as SSD KV Cache will become a standard. Also for AI industry as a whole - making AI affordable meaning more people will start to use AI which in turn increase the demand faster. Now I'm seriously asking? What're next? Are we ready for a post-Fable-open-source world?
顯示更多
0
22
415
49
轉發到社區