Helping ecosystem to grow on vLLM, ex-Head of APAC ecosystem @huggingface. Ex-Googler on TFLite/micro. Ideas on my own. Interested in future tech. DM open
You might have not understand what this means. If this is true, and DS-v4-Pro is open sourced, then gg Opus or even Fable đ
This means that DS is able to offer Fable level model at 1/50 API price with a much higher cache hit rate compared to Anthropic, thanks to DS v4's ultra small sparse KV Cache.
The total cost might be 1/100 lower while the model capability is pretty much the same.
Bullish for storage as SSD KV Cache will become a standard. Also for AI industry as a whole - making AI affordable meaning more people will start to use AI which in turn increase the demand faster.
Now I'm seriously asking? What're next? Are we ready for a post-Fable-open-source world?