Herding distributed systems by day and LLM obsessed by night. If you knew what our HFT was cooking youd be jelly đ
Check my Highlights tab for LLM-only stuff!
No I do think wenfeng is right and continual learning is the next unlock.
General intelligence is not sufficient to excel in a niche domain. Unless you learn the domain (in weights) you will always end up doing (and repeating) search/exploration which is (exponentially) time consuming and non deterministic
Md files are caching on top of search and exploration but again end up consuming valuable context lenth and move search from environment onto context length