Transformers, Deep Learning, Time Series Analysis, Forecasting, Machine Learning.
the attention mechanism. The model also encodes a sparsity bias into the attention scheme. This helps improve the memory complexity Informer [3]: Addresses memory/time complexity and error complexity issues caused by an auto-regressive decoder by proposing a new architecture and a direct-multi-step