注册并分享邀请链接,可获得视频播放与邀请奖励。

Omar Khattab
@lateinteraction
asst professor @MIT CSAIL @nlp_mit. (@DSPyOSS), GEPA, RLMs, Pedagogical RL
加入 December 2022
3.5K 正在关注    38.6K 粉丝
Intuition: Compaction is agentic recurrence (RNNs), whereas recursion (RLMs) is agentic attention. Recurrence maintains a constant-size state at all times by compressing the past. Attention keeps all context fully represented and then decides how to re-process it for each step.
显示更多
0
16
498
49
转发到社区