I’m coming around to
@ylecun’s JEPA …
When you study quantum mechanics deeply enough, you realize that living systems have holographic computing substrates called microtubules … which form long-range coherent networks … and those are holographic!
JEPA is very hologram-esque:
— predicts in embedding space, not pixels (holograms encode interference, not images)
— masked prediction = whole-in-part (any fragment constrains the whole)
— relational, not absolute (meaning = predictability between parts)
— EBM framing = learned holographic associative memory (cf. Plate HRRs, Kanerva SDM)
Yann LeCun says LLMs are strongest in domains where language itself is the substrate of reasoning, like math and code
They can solve problems, prove theorems, and write programs — but they are not creative mathematicians, software architects, or computer scientists
"their role is to help humans build"
더 보기