Transformers, Deep Learning, Time Series Analysis, Forecasting, Machine Learning.
loss. They then validate this claim with a set of one-layer linear models which outperform the transformer benchmarks in almost every experiment. In simpler terms, Transformers may not be the most ideal architecture for forecasting problems. In this post, I aim to summarize the findings and