Transformers, Deep Learning, Time Series Analysis, Forecasting, Machine Learning.
overfitting to the provided data, which could explain why the Linear models perform better. After evaluating the various transformer models, the authors also dived specifically into the effectiveness of self-attention and embedding strategies used by these models. Their first experiment involved