at://
/
app.bsky.feed.post
/
3lpnp2zwot22y
sign in
All
4
Record
2
Post
1
PostEmbed
1
Post
by @danabra.mov
PostEmbed
by @danabra.mov
Record
by @jimpick.com
Record
by @atsui.org
+ new component
Post
🧵[3/n] 📉 Even Gradients Are Sparse in RL 📉 🧠 In PRIME, 72% of parameters never receive any gradient — ever! ↔️ Some do, but their gradients cancel out over time. 🎯 It’s not just sparse updates, even the gradients are sparse
May 21, 2025
Sagnik Mukherjee
