注册并分享邀请链接,可获得视频播放与邀请奖励。

Tiezhen WANG
@Xianbao_QIAN
Helping ecosystem to grow on vLLM, ex-Head of APAC ecosystem @huggingface. Ex-Googler on TFLite/micro. Ideas on my own. Interested in future tech. DM open
加入 November 2022
2.9K 正在关注    12.9K 粉丝
You might have not understand what this means. If this is true, and DS-v4-Pro is open sourced, then gg Opus or even Fable 😅 This means that DS is able to offer Fable level model at 1/50 API price with a much higher cache hit rate compared to Anthropic, thanks to DS v4's ultra small sparse KV Cache. The total cost might be 1/100 lower while the model capability is pretty much the same. Bullish for storage as SSD KV Cache will become a standard. Also for AI industry as a whole - making AI affordable meaning more people will start to use AI which in turn increase the demand faster. Now I'm seriously asking? What're next? Are we ready for a post-Fable-open-source world?
显示更多
0
22
415
49
转发到社区