<p>Is there a seq-to-seq model which does not require to know the start and end of a sentence? I need to model a system which gets a long sequence of words and creates a long sequence of tokens as long as the input. For example it takes a sequence of 1000 words and creates a sequence of 1000 tokens, each token corresponds to an input word. </p>

CC BY-SA 4.0
2019-12-08T06:09:09.650Z
What do you mean? You mean a system that **tokenize** a sentence? A system taht does that do that does not need teh start of the sequence and anchor not does it uses a neural network based approach.
Clement
CC BY-SA 4.0
2019-12-24T08:46:13.517Z
So, isn't there any model that creates a seq-to-seq model without tokenizing?
Atena
<deep-learning><sequence-modeling>
Sequence-to-Sequence models without specifying the start and end of sentences
Atena
# Sequence-to-Sequence models without specifying the start and end of sentences

(Asked by: username_0 on 2019-12-07)

Is there a seq-to-seq model which does not require to know the start and end of a sentence? I need to model a system which gets a long sequence of words and creates a long sequence of tokens as long as the input. For example it takes a sequence of 1000 words and creates a sequence of 1000 tokens, each token corresponds to an input word.

**Tags:** deep-learning, sequence-modeling

> **Comments:**
> **username_1**: What do you mean? You mean a system that **tokenize** a sentence? A system taht does that do that does not need teh start of the sequence and anchor not does it uses a neural network based approach.  
> **username_0**: So, isn't there any model that creates a seq-to-seq model without tokenizing?  

---

## 0 answers

