Deep Learning, Machine Learning, Attention Mechanism, Time Series Analysis, Coding.
article about its main algorithm informer. 3. LogSparse Attention There are two drawbacks of the full attention that we discussed earlier: 1. Locality-agnostics (interesting, isn’t it?) 2. Memory bottleneck. To cope with these two, researchers used convolutional operators and LogSparse