๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Tiezhen WANG
@Xianbao_QIAN
Helping ecosystem to grow on vLLM, ex-Head of APAC ecosystem @huggingface. Ex-Googler on TFLite/micro. Ideas on my own. Interested in future tech. DM open
๊ฐ€์ž… November 2022
2.9K ํŒ”๋กœ์ž‰ ์ค‘    12.9K ํŒฌ
You might have not understand what this means. If this is true, and DS-v4-Pro is open sourced, then gg Opus or even Fable ๐Ÿ˜… This means that DS is able to offer Fable level model at 1/50 API price with a much higher cache hit rate compared to Anthropic, thanks to DS v4's ultra small sparse KV Cache. The total cost might be 1/100 lower while the model capability is pretty much the same. Bullish for storage as SSD KV Cache will become a standard. Also for AI industry as a whole - making AI affordable meaning more people will start to use AI which in turn increase the demand faster. Now I'm seriously asking? What're next? Are we ready for a post-Fable-open-source world?
๋” ๋ณด๊ธฐ