Answers.Body: <p>You simply split the sequence into smaller sequences; while there are some long-distance dependencies in language, that is generally not a problem for this.</p>
  <p>A sentence would typically be short enough, and very long sentences are composed of shorter clauses which would form independent units (albeit connected with each other).</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-08-23T16:10:52.370Z
Answers.Text: How would this "splitting" be done in practice? How are these clauses found? Would this require another model or is it just a matter of defining a set of segmentation rules?
Answers.UserDisplayName: Blencer
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-08-23T16:14:40.077Z
Answers.Text: I don't know, but I'd guess it would just be by length. I doubt that there would much linguistic knowledge behind it, as it would generally be language independent. Maybe on commas or other punctuation marks.
Answers.UserDisplayName: Oliver Mason
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-08-22T12:15:04.087Z
Answers.LastActivityDate: 2021-08-22T12:15:04.087Z
Answers.UserDisplayName: Oliver Mason
Body: <p>Sequence-to-sequence models with attention are known to be limited by a maximum sequence length. So how can we handle sequences of arbitrarily large size? Do we just set a very large maximum sequence length?</p>
  
Tags: <recurrent-neural-networks><transformer><machine-translation>
Title: How is Google Translate able to translate texts of arbitrarily large length?
UserDisplayName: Blencer
ThreadText: # How is Google Translate able to translate texts of arbitrarily large length?
  
  (Asked by: username_0 on 2021-08-21)
  
  Sequence-to-sequence models with attention are known to be limited by a maximum sequence length. So how can we handle sequences of arbitrarily large size? Do we just set a very large maximum sequence length?
  
  **Tags:** recurrent-neural-networks, transformer, machine-translation
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2021-08-22. Score: 2
  
  You simply split the sequence into smaller sequences; while there are some long-distance dependencies in language, that is generally not a problem for this.
  
  A sentence would typically be short enough, and very long sentences are composed of shorter clauses which would form independent units (albeit connected with each other).
  
  > **Comments:**
  > **username_0**: How would this "splitting" be done in practice? How are these clauses found? Would this require another model or is it just a matter of defining a set of segmentation rules?  
  > **username_1**: I don't know, but I'd guess it would just be by length. I doubt that there would much linguistic knowledge behind it, as it would generally be language independent. Maybe on commas or other punctuation marks.  
  
  ---
  
  