Transformers, Deep Learning, Time Series Analysis, Forecasting, Machine Learning.
nature of self-attention does cause significant temporal loss. Additionally, a linear model is incredibly interpretable and explainable compared to the complicated architecture of a Transformer. If some modifications are made to these components of LTSF Transformers, we may see them eventually beat