//
sign in
Post
by @danabra.mov
PostEmbed
by @danabra.mov
Record
by @jimpick.com
Record
by @atsui.org
+ new component
Post
x.com/kellerjordan...
7d
One motivation for me to add these optimizers was seeing @_arohan_, a senior researcher whose contributions I respect, repeatedly claim that Muon is Shampoo. IIUC, his argument is that if we disable accumulation in both Muon and Shampoo, then they become... 4/6 https://t.co/FsjAnJdJOx
x.com
Keller Jordan on X: "One motivation for me to add these optimizers was seeing @_arohan_, a senior researcher whose contributions I respect, repeatedly claim that Muon is Shampoo. IIUC, his argument is that if we disable accumulation in both Muon and Shampoo, then they become... 4/6 https://t.co/FsjAnJdJOx" / X