Glossary · Phase 4 · Deep learning
Closure
A small function that remembers the values around it when it was made. Autograd stores one per operation to run its backward step later.
Learn it properly
Build an autograd engine · Write backprop yourself in ~100 lines (micrograd). About 40 minutes.
Other terms from the same lesson
- autograd: Software that works out gradients automatically from the computation graph, so you never do it by hand.