Lossless

Changing how something is computed without changing the result at all, such as speculative decoding producing exactly what the big model would have.

Other terms from the same lesson

• draft model: In speculative decoding, the small fast model that guesses the next few tokens for the big model to check.
• speculative decoding: Speeding up generation by letting a small model draft several tokens and a big model check them at once.