Glossary · Phase 4 · Deep learning
D_model
The width of a transformer: how many numbers stand for each token as it passes through the layers.
Learn it properly
Embedding layers · Learned lookup tables that turn tokens into vectors. About 30 minutes.
Other terms from the same lesson
- embedding layer: A lookup table that gives each word or token its own learned list of numbers.