Glossary · Phase 4 · Deep learning
Autograd
Software that works out gradients automatically from the computation graph, so you never do it by hand.
Learn it properly
Build an autograd engine · Write backprop yourself in ~100 lines (micrograd). About 40 minutes.
Other terms from the same lesson
- closure: A small function that remembers the values around it when it was made. Autograd stores one per operation to run its backward step later.