Math

math

Optimizers, convergence, intuition behind the proofs.

Articles (2)

2025-12-04

The 60-second mental model for the optimizer ladder you actually need to know.

2025-08-30

The geometry of why per-parameter learning rates dominate vanilla SGD on transformers.