Deep Learning Systems
I really like the sneers about some terrible naming, e.g. in the slide on "The self-attention operation":<p><i>> “keys”, “queries”, “values”, in one of the
least-meaningful semantic designations we have in deep learning</i><p>And in the context of LSTMs:<p><i>> throwing in some other names, like “forget gate”, “input gate”, “output gate” for
good measure</i><p>This makes me feel more confident about actually understanding these topics.  Before, I was totally misled by the awkward terminology.