註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Omar Khattab
@lateinteraction
asst professor @MIT CSAIL @nlp_mit. (@DSPyOSS), GEPA, RLMs, Pedagogical RL
加入 December 2022
3.5K 正在關注    38.6K 粉絲
Intuition: Compaction is agentic recurrence (RNNs), whereas recursion (RLMs) is agentic attention. Recurrence maintains a constant-size state at all times by compressing the past. Attention keeps all context fully represented and then decides how to re-process it for each step.
顯示更多
0
16
498
49
轉發到社區