Query

In attention, what a token is looking for, like a search you type.

Other terms from the same lesson

• key: In attention, what a token offers to be matched on, like a page's index entry.
• value: In attention, the information a token passes along when it is matched, like the page you get back.