Optimizer comparison
Contour visualization inspired by Alec Radford — SGD, Adam, AdamW and Muon
Step 0
Click on the surface to set a custom start point
Speed
3
Surface
Rosenbrock
Beale
Himmelblau
Ackley
Custom start: off
Pause
Reset
Learning rates
Same LR for all