Body: <p>I'm trying to re-invent the code that would do it in the same way as in the vec2text article. Does anybody here have something similar?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-09-14T12:28:15.210Z
Comments.Text: please don't assume anything, cite articles, post code, and potentially explain extensively what you want to do
Comments.UserDisplayName: Alberto
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-09-14T12:29:41.633Z
Comments.Text: also, consider that the embedding is a latent space, where the token space instead is a one hot encoding, thus has no latent structure... the best you IMHO can do is train a decoder to learn a psudo inverse of such embedding matrix
Comments.UserDisplayName: Alberto
Tags: <embeddings>
Title: How to recover the text of the sentence from an embedding (vec2text)?
UserDisplayName: Alex Fedotov
ThreadText: # How to recover the text of the sentence from an embedding (vec2text)?
  
  (Asked by: username_0 on 2023-09-14)
  
  I'm trying to re-invent the code that would do it in the same way as in the vec2text article. Does anybody here have something similar?
  
  **Tags:** embeddings
  > **Comments:**
  > **username_1**: please don't assume anything, cite articles, post code, and potentially explain extensively what you want to do  
  > **username_1**: also, consider that the embedding is a latent space, where the token space instead is a one hot encoding, thus has no latent structure... the best you IMHO can do is train a decoder to learn a psudo inverse of such embedding matrix  
  
  ---
  
  ## 0 answers
  
  