Training loop

The repeated cycle of training: predict, measure the loss, backpropagate, update the weights.

Other terms from the same lesson

• checkpoint: A saved copy of a model's weights at some point in training, so you can go back to it or resume later.
• state_dict: PyTorch's dictionary of a model's weights by name. Saving and loading it is how you keep or restore a trained model.