Register and share your invite link to earn from video plays and referrals.

Tiezhen WANG
@Xianbao_QIAN
Helping ecosystem to grow on vLLM, ex-Head of APAC ecosystem @huggingface. Ex-Googler on TFLite/micro. Ideas on my own. Interested in future tech. DM open
Joined November 2022
2.9K Following    12.9K Followers
Actually I start to love the new open source release project - API first then open weights followed. The API exclusive period can give them early feedback and allow them to further optimize the model. When weights are released, they have been battle tested which will save a lot of time for the community :) Downloading a weights is so challenging now!
Show more
You might have not understand what this means. If this is true, and DS-v4-Pro is open sourced, then gg Opus or even Fable 😅 This means that DS is able to offer Fable level model at 1/50 API price with a much higher cache hit rate compared to Anthropic, thanks to DS v4's ultra small sparse KV Cache. The total cost might be 1/100 lower while the model capability is pretty much the same. Bullish for storage as SSD KV Cache will become a standard. Also for AI industry as a whole - making AI affordable meaning more people will start to use AI which in turn increase the demand faster. Now I'm seriously asking? What're next? Are we ready for a post-Fable-open-source world?
Show more