Answers.Body: <p>An option that I have thought of before is to label the embeddings as good (basically take any public database good enough that has labeled data without grammatical errors).</p>
  <p>Once you have these, you can find the top k eigenvectors by performing PCA with low variance, and there you can say with a certain confidence that these correspond to having fewer grammatical errors.</p>
  <p>NOTE: Due to the black-box nature of Neural Networks, you can never certainly say that the eigenvector with low variance in this case has to correspond to grammar.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-07-05T00:53:40.293Z
Answers.LastActivityDate: 2023-07-05T00:53:40.293Z
Answers.UserDisplayName: Chinmay
Body: <p>Imagine a large set of text embeddings (e.g. by OpenAI model), created on user inputs in a natural language interface (e.g. a semantic search app), which we want to cluster on some &quot;non-topic aspect&quot; of the text (e.g. clarity of query). As expected, clustering by default results in different topics being grouped together.</p>
  <p>What are the best practices to ignore the topics when clustering if we define topics as whatever some dimensionality reduction process favours (e.g. the clusters we get initially)?</p>
  <p>Alternatively, is there some documented/researched process of training additional models on top of these embeddings (or adding layers to existing models) to boost these different aspects of the embedded text, or at least to achieve this &quot;blindness&quot; to certain aspects of the embedding (with some additional train data)?</p>
  <p>Of course, I am assuming that these other aspects are also contained in the embedding, they are just less expressed.</p>
  
Tags: <embeddings><large-language-models>
Title: Ignoring aspects of text embeddings, e.g. making the embedding topic-agnostic
UserDisplayName: curl-up
ThreadText: # Ignoring aspects of text embeddings, e.g. making the embedding topic-agnostic
  
  (Asked by: username_0 on 2023-07-04)
  
  Imagine a large set of text embeddings (e.g. by OpenAI model), created on user inputs in a natural language interface (e.g. a semantic search app), which we want to cluster on some "non-topic aspect" of the text (e.g. clarity of query). As expected, clustering by default results in different topics being grouped together.
  
  What are the best practices to ignore the topics when clustering if we define topics as whatever some dimensionality reduction process favours (e.g. the clusters we get initially)?
  
  Alternatively, is there some documented/researched process of training additional models on top of these embeddings (or adding layers to existing models) to boost these different aspects of the embedded text, or at least to achieve this "blindness" to certain aspects of the embedding (with some additional train data)?
  
  Of course, I am assuming that these other aspects are also contained in the embedding, they are just less expressed.
  
  **Tags:** embeddings, large-language-models
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2023-07-05. Score: 1
  
  An option that I have thought of before is to label the embeddings as good (basically take any public database good enough that has labeled data without grammatical errors).
  
  Once you have these, you can find the top k eigenvectors by performing PCA with low variance, and there you can say with a certain confidence that these correspond to having fewer grammatical errors.
  
  NOTE: Due to the black-box nature of Neural Networks, you can never certainly say that the eigenvector with low variance in this case has to correspond to grammar.
  
  
  ---
  
  