๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Randall Balestriero
@randall_balestr
AI Researcher: From theory to practice (and back) Postdoc @MetaAI with @ylecun PhD @RiceUniversity with @rbaraniuk Masters @ENS_Ulm @Paris_Sorbonne
๊ฐ€์ž… April 2020
246 ํŒ”๋กœ์ž‰ ์ค‘    6.9K ํŒฌ
LeJEPA already identified the world's latents--up to some mixing. There is now a very simple post-training recipe to undo that ambiguity and to recover the disentangled world's features! What a time to be Gaussian :) ๐Ÿ“„
๋” ๋ณด๊ธฐ
Is it possible to provably recover individual latent variables of the true world, even without reconstruction (e.g., JEPA)? Yes, with DSReg, a simple regularization that can be applied post hoc to your pretrained model!
๋” ๋ณด๊ธฐ