Berker Demirel
@berkerdemirel97
PhD Candidate in Computer Science at IST Austria Working on Computer Vision and Deep Learning
355 Following 118 Followers
In JEPA, are we preventing collapse in the representation we actually use downstream?
TLDR: not necessarily. A high-rank projected representation does not guarantee a non-collapsed backbone.
λ-JEPA is designed to target this gap.
Show more
