No I do think wenfeng is right and continual learning is the next unlock.
General intelligence is not sufficient to excel in a niche domain. Unless you learn the domain (in weights) you will always end up doing (and repeating) search/exploration which is (exponentially) time consuming and non deterministic
Md files are caching on top of search and exploration but again end up consuming valuable context lenth and move search from environment onto context length
顯示更多