Transformers, Deep Learning, Time Series Analysis, Forecasting, Machine Learning.
the transformers are capturing less temporal information than the linear models. The full results can be found in the table below Table 2: (Figure produced by Zeng et al. [1]) To further dive into the information-capturing capabilities of transformers, the authors examined the effectiveness of