We should subject JEPA-like architectures to images of the sky to see if they “discover” a) differences between objects such as stars and planets; b) laws that govern how they move.
So much of ancient science was dominated by astronomy, making it a good target for AI-scientists.