Body: <p>Word2Vec model does not use any neural network. It uses logistic regression only.</p>
  <p>Consider the following paragraph from p:18 of <a href="https://web.stanford.edu/%7Ejurafsky/slp3/6.pdf" rel="nofollow noreferrer">Vector Semantics and Embeddings</a></p>
  <blockquote>
  <p>We’ll  see  how  to  do  neural  networks  in  the  next  chapter,
  but  <strong>word2vec  is  a much simpler model than the neural network
  language model</strong>, in two ways.  First,word2vec simplifies the task
  (making it binary classification instead of word prediction). Second,
  word2vec simplifies the architecture (<strong>training a logistic
  regression classifier instead of a multi-layer neural network with
  hidden layers that demand more sophisticated training algorithms</strong>). The
  intuition of skip-gram is:</p>
  <ol>
  <li><p>Treat the target word and a neighboring context word as positive examples.</p>
  </li>
  <li><p>Randomly sample other words in the lexicon to get negative samples.</p>
  </li>
  <li><p>Use logistic regression to train a classifier to distinguish those two cases.</p>
  </li>
  <li><p>Use the learned weights as the embeddings.</p>
  </li>
  </ol>
  </blockquote>
  <p>But, why it is called a neural model then? Is there any version of Word2Vec that use neural network?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-11T06:42:14.170Z
Comments.Text: Please write a comment for downvote so that I can improve my question.
Comments.UserDisplayName: hanugm
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-11T09:28:30.623Z
Comments.Text: The Wikipedia article for word2vec https://en.wikipedia.org/wiki/Word2vec says that a neural network is indeed used: "The word2vec algorithm uses a neural network model to learn word associations from a large corpus of text." What made you think that a neural network isn't used?
Comments.UserDisplayName: The Pointer
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-11T09:29:49.510Z
Comments.Text: @ThePointer But the textbook I read is saying differently. It is using logistic regression only.
Comments.UserDisplayName: hanugm
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-11T09:30:55.110Z
Comments.Text: Please provide a reference to your textbook and where it is implied that word2vec only uses logistic regression.
Comments.UserDisplayName: The Pointer
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-11T09:37:40.267Z
Comments.Text: @ThePointer I updated the question. If there are several variants, please provide an answer, if possible, that there are several variants for the same Word2Vec model and one of them uses neural network
Comments.UserDisplayName: hanugm
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-11T09:40:16.440Z
Comments.Text: This is beyond my level of knowledge at the moment, so it's best to leave it to someone else.
Comments.UserDisplayName: The Pointer
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-27T19:36:51.137Z
Comments.Text: Logistic regression can and often is accomplished through logistic regression.  That's what a binary or sentiment analysis is.
Comments.UserDisplayName: David Hoelzer
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-27T21:46:54.917Z
Comments.Text: @DavidHoelzer *Logistic regression can and often is accomplished through logistic regression*... Do you mean *Logistic regression can and often is accomplished through neural network*?
Comments.UserDisplayName: hanugm
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-28T11:31:03.363Z
Comments.Text: @hanugm Yes, that's exactly what I meant.  Oops. :)
Comments.UserDisplayName: David Hoelzer
Tags: <neural-networks><terminology><word2vec><books>
Title: Why Word2Vec is called a neural model if no neural network is used in it?
UserDisplayName: hanugm
ThreadText: # Why Word2Vec is called a neural model if no neural network is used in it?
  
  (Asked by: username_0 on 2021-06-11)
  
  Word2Vec model does not use any neural network. It uses logistic regression only.
  
  Consider the following paragraph from p:18 of [Vector Semantics and Embeddings](https://web.stanford.edu/%7Ejurafsky/slp3/6.pdf)
  
  > We’ll see how to do neural networks in the next chapter,
  > but **word2vec is a much simpler model than the neural network
  > language model**, in two ways. First,word2vec simplifies the task
  > (making it binary classification instead of word prediction). Second,
  > word2vec simplifies the architecture (**training a logistic
  > regression classifier instead of a multi-layer neural network with
  > hidden layers that demand more sophisticated training algorithms**). The
  > intuition of skip-gram is:
  >
  > 1. Treat the target word and a neighboring context word as positive examples.
  > 2. Randomly sample other words in the lexicon to get negative samples.
  > 3. Use logistic regression to train a classifier to distinguish those two cases.
  > 4. Use the learned weights as the embeddings.
  
  But, why it is called a neural model then? Is there any version of Word2Vec that use neural network?
  
  **Tags:** neural-networks, terminology, word2vec, books
  > **Comments:**
  > **username_0**: Please write a comment for downvote so that I can improve my question.  
  > **username_1**: The Wikipedia article for word2vec https://en.wikipedia.org/wiki/Word2vec says that a neural network is indeed used: "The word2vec algorithm uses a neural network model to learn word associations from a large corpus of text." What made you think that a neural network isn't used?  
  > **username_0**: @ThePointer But the textbook I read is saying differently. It is using logistic regression only.  
  > **username_1**: Please provide a reference to your textbook and where it is implied that word2vec only uses logistic regression.  
  > **username_0**: @ThePointer I updated the question. If there are several variants, please provide an answer, if possible, that there are several variants for the same Word2Vec model and one of them uses neural network  
  > **username_1**: This is beyond my level of knowledge at the moment, so it's best to leave it to someone else.  
  > **username_2**: Logistic regression can and often is accomplished through logistic regression.  That's what a binary or sentiment analysis is.  
  > **username_0**: @DavidHoelzer *Logistic regression can and often is accomplished through logistic regression*... Do you mean *Logistic regression can and often is accomplished through neural network*?  
  > **username_2**: @hanugm Yes, that's exactly what I meant.  Oops. :)  
  
  ---
  
  ## 0 answers
  
  