LLM

Also written: LLMs, large language model, large language models

A large language model: a program trained on huge amounts of text to predict the next word, which lets it write, answer and reason.

Other terms from the same lesson

• click-through rate: The share of people who saw a link or ad and clicked it: clicks divided by views.
• conversion rate: The share of people who went on to do the thing you wanted, such as buying, out of those who clicked.
• next-token prediction: The one task a language model is trained on: guess the next piece of text from everything before it.
• sampling: Picking the next token at random according to the model's probabilities, instead of always taking the top one.
• vocabulary: The full list of tokens a model knows.