Glossary · Phase 5 · Transformers
N-gram
A model that predicts the next item from the previous n − 1 items. A bigram uses one, a trigram two.
Learn it properly
A bigram model · The simplest language model, built from counts. About 35 minutes.
Other terms from the same lesson
- bigram: A pair of neighbouring tokens. A bigram model predicts the next token from only the one before.