AI, Computer Science, Philosophy, Dynamic Programming, Machine Learning.
really long n-grams (at least in theory). Transformers introduce Dynamic Programming like attention mechanism and thus we are able to use Fuzzy Lookup Table-like system, that memorizes useful skip-grams instead of n-grams. If you want a more detailed introduction to early neural networks, you might