Contrary to what Big Scale has you believe, equivariant models are alive and thriving 😉
Jokes aside, there is increasing evidence that enforcing symmetry is beneficial in certain applications.
arxiv.org/abs/2510.01349
arxiv.org/abs/2605.18816
Symmetry-aware methods for machine learning, such as data augmentation and equivariant architectures, encourage correct model behavior on all transformations (e.g. rotations or permutations) of the or...