Glossary · Phase 4 · Deep learning
Embedding layer
A lookup table that gives each word or token its own learned list of numbers.
Learn it properly
Embedding layers · Learned lookup tables that turn tokens into vectors. About 30 minutes.
Other terms from the same lesson
- d_model: The width of a transformer: how many numbers stand for each token as it passes through the layers.