Attention Quiz

Making models run faster The same word having different meanings in different contexts Reducing memory usage Translating between languages

The importance of words in the vocabulary How relevant each word is for understanding another word The position of words in a sentence The frequency of words in training data

The information a word provides What a word is "asking" or looking for How a word should be matched The word's position in the sentence

A fixed vector for each word A word representation that changes based on surrounding words The position encoding of a word A compressed version of the input text

"I" and "went" "to" and "the" "deposit" and "money" All words equally