Lisan al Gaib(@scaling01):Schmidhubers argument for consciousness in LLMs: - the one constant in training and during RL rollouts that influences the next token prediction is the model itself, so models should learn to model themselves to better predict what comes next claiming that this results in conscious AI is silly I think at best this gives you self-awareness/some metacognition which models already have, but not consciousness

Lisan al Gaib

@scaling01

lead them to paradise LisanBench: Impressum & Datenschutz:

가입 August 2024

1.3K 팔로잉 중 57.5K 팬

Lisan al Gaib@scaling01

2026.07.04 19:12

Schmidhubers argument for consciousness in LLMs: - the one constant in training and during RL rollouts that influences the next token prediction is the model itself, so models should learn to model themselves to better predict what comes next claiming that this results in conscious AI is silly I think at best this gives you self-awareness/some metacognition which models already have, but not consciousness