Great blog post on rotary position embeddings (RoPE) in more than one dimension, with interactive visualisations, a bunch of experimental results, and code!
An exploration of N-dimensional rotary positional embeddings (RoPE) for vision transformers.
The Creative AI track (formerly Machine Learning for Creativity and Design) at @neuripsconf.bsky.social has always been a home for interdisciplinarity. As its co-chair, I invite research and artworks exploring and critiquing of ML in art, design, and creative practice.
neurips.cc/Conferences/...
1/n
Sander Dieleman
My first blog post in over a year is a deep dive on flow maps🗺️, or how to learn the integral of a diffusion model to enable faster sampling and several other cool tricks.
It's the longest one yet👀 Let me know what you think!
sander.ai/2026/05/06/f...
Everyone is welcome!
I blog and give talks to help build people's intuition for diffusion models. YouTubers like @3blue1brown.com and Welch Labs have been a huge inspiration: their ability to make complex ideas in maths and physics approachable is unmatched. Really great to see them tackle this topic!
... also very honoured and grateful to see my blog linked in the video description! 🥹🙏🙇
