注册并分享邀请链接,可获得视频播放与邀请奖励。

Drew Breunig
@dbreunig
Writing about and working on AI, DSPy, geo, and data. Trying to prevent prompt debt and help others build maintainable intelligent applications.
加入 March 2008
1.2K 正在关注    10.4K 粉丝
The most recent batch of models start to respond in a limited and localized vocabulary as you go over ~200k context. Unique terms are adopted, more like pointers (symbolic) than jargon (language). At least it feels that way to me. I end up spending significant effort getting them to “decompile” this dialect when writing reports, or even product copy.
显示更多
I bet we figure out that neural networks can be decomposed into evolved symbolic systems of sorts and that it will be achieved before capital S Superintelligence but everyone has to lock in