at://
/
app.bsky.feed.post
/
3luztqoaj3s2h
sign in
All
4
Record
2
Post
1
PostEmbed
1
Post
by @danabra.mov
PostEmbed
by @danabra.mov
Record
by @jimpick.com
Record
by @atsui.org
+ new component
Post
Great blog post on rotary position embeddings (RoPE) in more than one dimension, with interactive visualisations, a bunch of experimental results, and code!
10mo
An exploration of N-dimensional rotary positional embeddings (RoPE) for vision transformers.
jerryxio.ng
On N-dimensional Rotary Positional Embeddings
Sander Dieleman
