<p>You simply split the sequence into smaller sequences; while there are some long-distance dependencies in language, that is generally not a problem for this.</p>
<p>A sentence would typically be short enough, and very long sentences are composed of shorter clauses which would form independent units (albeit connected with each other).</p>

CC BY-SA 4.0
2021-08-23T16:10:52.370Z
How would this "splitting" be done in practice? How are these clauses found? Would this require another model or is it just a matter of defining a set of segmentation rules?
Blencer
CC BY-SA 4.0
2021-08-23T16:14:40.077Z
I don't know, but I'd guess it would just be by length. I doubt that there would much linguistic knowledge behind it, as it would generally be language independent. Maybe on commas or other punctuation marks.
Oliver Mason
CC BY-SA 4.0
2021-08-22T12:15:04.087Z
2021-08-22T12:15:04.087Z
Oliver Mason
<p>Sequence-to-sequence models with attention are known to be limited by a maximum sequence length. So how can we handle sequences of arbitrarily large size? Do we just set a very large maximum sequence length?</p>

<recurrent-neural-networks><transformer><machine-translation>
How is Google Translate able to translate texts of arbitrarily large length?
Blencer
# How is Google Translate able to translate texts of arbitrarily large length?

(Asked by: username_0 on 2021-08-21)

Sequence-to-sequence models with attention are known to be limited by a maximum sequence length. So how can we handle sequences of arbitrarily large size? Do we just set a very large maximum sequence length?

**Tags:** recurrent-neural-networks, transformer, machine-translation


---

## 1 answers

### Answer by username_1 on 2021-08-22. Score: 2

You simply split the sequence into smaller sequences; while there are some long-distance dependencies in language, that is generally not a problem for this.

A sentence would typically be short enough, and very long sentences are composed of shorter clauses which would form independent units (albeit connected with each other).

> **Comments:**
> **username_0**: How would this "splitting" be done in practice? How are these clauses found? Would this require another model or is it just a matter of defining a set of segmentation rules?  
> **username_1**: I don't know, but I'd guess it would just be by length. I doubt that there would much linguistic knowledge behind it, as it would generally be language independent. Maybe on commas or other punctuation marks.  

---

