Transformers, Deep Learning, Time Series Analysis, Forecasting, Machine Learning.
Transformers should perform better with longer input sequences, and the authors test this hypothesis in their next experiment. They vary the look-back period between 24 and 720 time steps and evaluate the MSE. The authors found that in many cases, the performance of the transformers did not improve