Transformers, Deep Learning, Time Series Analysis, Forecasting, Machine Learning.
linear layers. At each step, they recorded the MSE using various look-back period sizes and found that the performance of the transformer grows with the gradual simplification. The authors also wanted to examine the impact of the transformers to preserve temporal order. They hypothesized that since