Body: <p>Is there a seq-to-seq model which does not require to know the start and end of a sentence? I need to model a system which gets a long sequence of words and creates a long sequence of tokens as long as the input. For example it takes a sequence of 1000 words and creates a sequence of 1000 tokens, each token corresponds to an input word. </p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-12-08T06:09:09.650Z
Comments.Text: What do you mean? You mean a system that **tokenize** a sentence? A system taht does that do that does not need teh start of the sequence and anchor not does it uses a neural network based approach.
Comments.UserDisplayName: Clement
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-12-24T08:46:13.517Z
Comments.Text: So, isn't there any model that creates a seq-to-seq model without tokenizing?
Comments.UserDisplayName: Atena
Tags: <deep-learning><sequence-modeling>
Title: Sequence-to-Sequence models without specifying the start and end of sentences
UserDisplayName: Atena
ThreadText: # Sequence-to-Sequence models without specifying the start and end of sentences
  
  (Asked by: username_0 on 2019-12-07)
  
  Is there a seq-to-seq model which does not require to know the start and end of a sentence? I need to model a system which gets a long sequence of words and creates a long sequence of tokens as long as the input. For example it takes a sequence of 1000 words and creates a sequence of 1000 tokens, each token corresponds to an input word.
  
  **Tags:** deep-learning, sequence-modeling
  > **Comments:**
  > **username_1**: What do you mean? You mean a system that **tokenize** a sentence? A system taht does that do that does not need teh start of the sequence and anchor not does it uses a neural network based approach.  
  > **username_0**: So, isn't there any model that creates a seq-to-seq model without tokenizing?  
  
  ---
  
  ## 0 answers
  
  