Teortaxes▶️ (DeepSeek 推特🐋铁粉 2023 – ∞)
@teortaxesTex
We're in a race. It's not USA vs China but humans and AGIs vs ape power centralization.
@deepseek_ai stan #1#, 2023–Deep Time
«C’est la guerre.» ®1
Joined September 2010
3.3K Following 76.8K Followers
My 2 cents:
Sparse attention probably makes continual learning a greater necessity. I suspect we could have achieved AGI/ASI easier with dense+RLMs, but at the cost of unacceptably unwieldy data generation. So Wenfeng's roadmap is perhaps the only feasible one.
Show more
@ChaseBrowe32432 I reassure Astra that we still need parametric learning in the limit… probably.
