Answers.Body: <p>Word2vec works on the concept of  typical word co-occurrences. This means that it will work well only for words that occur frequently in the dataset. So proper nouns will not play any role in training the model. You can keep the proper nouns as they are or use only the words the occur more frequently than some threshold value based on the size of your dataset.</p>
  
  <p>Once you use the value stored in variable <code>x</code> for something, and then change the stored value, it will not reflect anywhere unless you us use the variable <code>x</code> again somewhere in the program.</p>
  
  
  
  <pre><code># Example
  x = "something something"
  print(x + "...")
  
  # Result
  something something ...
  
  # Changing x
  x = "new value"
  
  # This new value of x will not reflect anywhere in the program
  # Unless you use the variable x again.
  </code></pre>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-06-18T16:12:17.580Z
Answers.Text: i am thinking about interpreting knoledge from the text. For example, let me quote some article : "We propose a new network architecture for learning on graphs Unlike the traditional multi-head attention mechanism" Interpreting its information is sort of structure (in pseudo-code) : x = Subject (first_person_plural); main = Fact(propose_info_action, x, y) ; y =  info_method(of : neural_network, creation_time : new, tool_function = z) , z = Learning(info, learning_source : graph_information(plural)),
Answers.UserDisplayName: user8426627
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-06-18T16:13:18.887Z
Answers.Text: so items have kind of relation among each object and the link between sentences where an object occures. Word2vec seems completely not capable to do that since the info it extracts is more primitive?
Answers.UserDisplayName: user8426627
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-06-18T13:39:24.290Z
Answers.LastActivityDate: 2019-06-18T13:39:24.290Z
Answers.UserDisplayName: skillsmuggler
Body: <p>The input in word2vec is known word (spellings), each tagged by its ID.</p>
  
  <ul>
  <li>But if you process real text, there can be not only dictionary words but also proper nouns like human names, trade marks, file names , etc, how to make an input for that? </li>
  <li>Is you consider some input where items are variables, like the meaning of input would be x = something, and after some time you acces to x value and define some other stuff with it. That would be format for this input, and will this approach work at all?</li>
  </ul>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-06-18T13:34:41.957Z
Comments.Text: I wasn't able to understand the second part completely, can you please explain with some sample code?
Comments.UserDisplayName: skillsmuggler
Tags: <neural-networks><recurrent-neural-networks>
Title: How to handle proper names or variable names in word2vec?
UserDisplayName: user8426627
ThreadText: # How to handle proper names or variable names in word2vec?
  
  (Asked by: username_0 on 2019-06-18)
  
  The input in word2vec is known word (spellings), each tagged by its ID.
  
  * But if you process real text, there can be not only dictionary words but also proper nouns like human names, trade marks, file names , etc, how to make an input for that?
  * Is you consider some input where items are variables, like the meaning of input would be x = something, and after some time you acces to x value and define some other stuff with it. That would be format for this input, and will this approach work at all?
  
  **Tags:** neural-networks, recurrent-neural-networks
  > **Comments:**
  > **username_1**: I wasn't able to understand the second part completely, can you please explain with some sample code?  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2019-06-18. Score: 1
  
  Word2vec works on the concept of  typical word co-occurrences. This means that it will work well only for words that occur frequently in the dataset. So proper nouns will not play any role in training the model. You can keep the proper nouns as they are or use only the words the occur more frequently than some threshold value based on the size of your dataset.
  Once you use the value stored in variable x for something, and then change the stored value, it will not reflect anywhere unless you us use the variable x again somewhere in the program.
  # Example
  x = "something something"
  print(x + "...")
  
  # Result
  something something ...
  
  # Changing x
  x = "new value"
  
  # This new value of x will not reflect anywhere in the program
  # Unless you use the variable x again.
  
  > **Comments:**
  > **username_0**: i am thinking about interpreting knoledge from the text. For example, let me quote some article : "We propose a new network architecture for learning on graphs Unlike the traditional multi-head attention mechanism" Interpreting its information is sort of structure (in pseudo-code) : x = Subject (first_person_plural); main = Fact(propose_info_action, x, y) ; y =  info_method(of : neural_network, creation_time : new, tool_function = z) , z = Learning(info, learning_source : graph_information(plural)),  
  > **username_0**: so items have kind of relation among each object and the link between sentences where an object occures. Word2vec seems completely not capable to do that since the info it extracts is more primitive?  
  
  ---
  
  