Deep Learning Systems
I really like the sneers about some terrible naming, e.g. in the slide on "The self-attention operation":> “keys”, “queries”, “values”, in one of the
least-meaningful semantic designations we have in deep learningAnd in the context of LSTMs:> throwing in some other names, like “forget gate”, “input gate”, “output gate” for
good measureThis makes me feel more confident about actually understanding these topics.  Before, I was totally misled by the awkward terminology.