Answers.Body: <p>Embedding is the process of representing data (from a source domain) in a new (or target) domain. Usually, the source domain is discrete, and the target domain is continuous. For example, embedding words into the continuous vector space can be done by the word2vec method.</p>
  <p>The main reason behind using the embedding is doing meaningful mathematical computations in the target domain, which is not possible or straightforward in the source domain. For example, summing two words <code>&quot;brother&quot; - &quot;man&quot; + &quot;woman&quot;</code> not meaningful in the word and character levels. However, when using word2vec, <code>embedding(&quot;brother&quot;) - embedding(&quot;man&quot;) + embedding(&quot;woman&quot;)</code> can be meaningful and comparable with other embedded vectors; It should be near the embedded vector of &quot;sister&quot;.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-01-01T02:20:59.370Z
Answers.Text: While this is of course correct, I'd add that also more abstract things like [manifolds](https://deepai.org/machine-learning-glossary-and-terms/manifold-hypothesis) can be said to exist in a higher dimensional embedding space. In that case, one refers to an arbitrary vector space as the embedding space (as well), but wants to express that the data under consideration lives/varies (meaningfully) essentially only along a subset of the dimensions used to represent the data, where this subset of dimensions is called *Manifold*. Also the manifold is *embedded* in a (higher dimensional) space.
Answers.UserDisplayName: Daniel B.
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-12-30T20:38:46.457Z
Answers.LastActivityDate: 2020-12-30T20:44:36.620Z
Answers.LastEditDate: 2020-12-30T20:44:36.620Z
Answers.UserDisplayName: OmG
Body: <p>In the machine learning literature, I often see it said that something is &quot;embedded&quot; in some space. For instance, that something is &quot;embedded&quot; in feature space, or that our data are &quot;embedded&quot; in dot product space, etc. However, I've never actually seen an explanation of what this is supposed to mean. So what does it actually mean to say that something is &quot;embedded&quot; in some space?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-12-30T20:04:33.850Z
Comments.Text: Your question is different, but the answer can be found [here](https://ai.stackexchange.com/a/20646/2444).
Comments.UserDisplayName: nbro
Tags: <machine-learning><terminology><definitions><embeddings>
Title: In the machine learning literature, what does it mean to say that something is "embedded" in some space?
UserDisplayName: The Pointer
ThreadText: # In the machine learning literature, what does it mean to say that something is "embedded" in some space?
  
  (Asked by: username_0 on 2020-12-30)
  
  In the machine learning literature, I often see it said that something is "embedded" in some space. For instance, that something is "embedded" in feature space, or that our data are "embedded" in dot product space, etc. However, I've never actually seen an explanation of what this is supposed to mean. So what does it actually mean to say that something is "embedded" in some space?
  
  **Tags:** machine-learning, terminology, definitions, embeddings
  
  > **Comments:**
  > **username_1**: Your question is different, but the answer can be found [here](https://ai.stackexchange.com/a/20646/2444).  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2020-12-30. Score: 1 | Accepted answer
  
  Embedding is the process of representing data (from a source domain) in a new (or target) domain. Usually, the source domain is discrete, and the target domain is continuous. For example, embedding words into the continuous vector space can be done by the word2vec method.
  
  The main reason behind using the embedding is doing meaningful mathematical computations in the target domain, which is not possible or straightforward in the source domain. For example, summing two words `"brother" - "man" + "woman"` not meaningful in the word and character levels. However, when using word2vec, `embedding("brother") - embedding("man") + embedding("woman")` can be meaningful and comparable with other embedded vectors; It should be near the embedded vector of "sister".
  
  > **Comments:**
  > **username_3**: While this is of course correct, I'd add that also more abstract things like [manifolds](https://deepai.org/machine-learning-glossary-and-terms/manifold-hypothesis) can be said to exist in a higher dimensional embedding space. In that case, one refers to an arbitrary vector space as the embedding space (as well), but wants to express that the data under consideration lives/varies (meaningfully) essentially only along a subset of the dimensions used to represent the data, where this subset of dimensions is called *Manifold*. Also the manifold is *embedded* in a (higher dimensional) space.  
  
  ---
  
  