I didn't know what JEPA is, and at this point I am too afraid to ask ...😬
so I made a video tracing the last 30+ years of self-supervised learning, covering ideas from contrastive learning, distillation, masked modeling, JEPA, and world models.
youtu.be/gVEr2cnDE_8
