🚨 arxiv.org/abs/2604.06129
PoM: A Linear-Time Replacement for Attention with the Polynomial Mixer
This paper is the result of doing a lab-wide hackathon on an idea I've had for some time. Probably the paper with the highest number of authors I've ever done.
It's a CVPR Findings 26.
Thread 🧵👇
arxiv.org
This paper introduces the Polynomial Mixer (PoM), a novel token mixing mechanism with linear complexity that serves as a drop-in replacement for self-attention. PoM aggregates input tokens into a comp...
