Glossary · Phase 5 · Transformers
Bigram
A pair of neighbouring tokens. A bigram model predicts the next token from only the one before.
Learn it properly
A bigram model · The simplest language model, built from counts. About 35 minutes.
Other terms from the same lesson
- n-gram: A model that predicts the next item from the previous n − 1 items. A bigram uses one, a trigram two.