Glossary · Phase 5 · Transformers
Temperature
A setting for how adventurous a model's word choices are: low is predictable, high is varied.
Learn it properly
Sampling strategies · Temperature, top-k and top-p: turning probabilities into text. About 30 minutes.
Other terms from the same lesson
- top-p: Sampling only from the most likely tokens, cutting off the unlikely tail.