Answers.Body: <p>If you would classify a transformer as Seq2Seq, then it is arguably the best. This is only arguably due to accuracy.</p>
  <p>Shallow neural networks or even decision trees and forests may be better in production due to lower training time, lower inference time and smaller size in memory.</p>
  <p>Overall, it requires a bit of a compromise, and you need to do what suits your use case. For example you wouldn't run GPT-3 on a raspberry pi pico (for example). So it depends on what you mean by &quot;best&quot;.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-08-09T12:35:30.433Z
Answers.LastActivityDate: 2021-08-09T12:35:30.433Z
Answers.UserDisplayName: Dom DJ
Body: <p>I understand that seq2seq models are perfectly suitable when the input and/or the output have variable lengths. However, if we know exactly the input/output sequence lengths of the neural network. Is this the best approach?</p>
  
Tags: <time-series><sequence-modeling><seq2seq>
Title: Is seq2seq the best model when input/output sequences have fixed length?
UserDisplayName: Petrus
ThreadText: # Is seq2seq the best model when input/output sequences have fixed length?
  
  (Asked by: username_0 on 2021-08-09)
  
  I understand that seq2seq models are perfectly suitable when the input and/or the output have variable lengths. However, if we know exactly the input/output sequence lengths of the neural network. Is this the best approach?
  
  **Tags:** time-series, sequence-modeling, seq2seq
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2021-08-09. Score: 0
  
  If you would classify a transformer as Seq2Seq, then it is arguably the best. This is only arguably due to accuracy.
  
  Shallow neural networks or even decision trees and forests may be better in production due to lower training time, lower inference time and smaller size in memory.
  
  Overall, it requires a bit of a compromise, and you need to do what suits your use case. For example you wouldn't run GPT-3 on a raspberry pi pico (for example). So it depends on what you mean by "best".
  
  
  ---
  
  