Glossary · Phase 5 · Transformers
Top-p
Sampling only from the most likely tokens, cutting off the unlikely tail.
Learn it properly
Sampling strategies · Temperature, top-k and top-p: turning probabilities into text. About 30 minutes.
Other terms from the same lesson
- temperature: A setting for how adventurous a model's word choices are: low is predictable, high is varied.