Answers.Body: <p><strong>1. Does BERT have any such models?</strong></p>
  <p>If you mean the <strong>pretrained model</strong>, then the answer is YES.
  BERT has Cased and Uncased models and also models for other language (<code>BERT-Base, Multilingual Cased</code> and <code>BERT-Base, Multilingual Uncased</code>, trained in 104 languages). You can check those models <a href="https://github.com/google-research/bert#pre-trained-models" rel="nofollow noreferrer">here</a>.</p>
  <p><strong>2. Is it possible to check similarity between two words using BERT?</strong></p>
  <p>Refer to <a href="https://colab.research.google.com/drive/1ZQvuAVwA3IjybezQOXnrXMGAnMyZRuPU#scrollTo=BokW7CAgMxCB" rel="nofollow noreferrer">this Google Colab Notebook</a>, it is <strong>not appopriate</strong> with BERT Embeddings for <strong>Word-Level similarity comparisons</strong>.</p>
  <p>However, doing <strong>sentence embedding similarity comparisons</strong> are still valid with BERT.</p>
  <p>That's it, hope it helps you :)</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-08-06T04:54:18.243Z
Answers.LastActivityDate: 2020-08-06T04:54:18.243Z
Answers.UserDisplayName: dimskii
Body: <p>I'm trying to compare Glove, Fasttext, Bert on the basis of similarity between 2 words using Pre-trained Models. Glove and Fasttext had pre-trained models that could easily be used with gensim word2vec in python.</p>
  <blockquote>
  <p><strong>Does BERT have any such models?</strong></p>
  <p><strong>Is it possible to check the similarity between two words using BERT?</strong></p>
  </blockquote>
  
Tags: <natural-language-processing><bert><similarity>
Title: Similarity score between 2 words using Pre-trained BERT using Pytorch
UserDisplayName: Pluviophile
ThreadText: # Similarity score between 2 words using Pre-trained BERT using Pytorch
  
  (Asked by: username_0 on 2020-04-30)
  
  I'm trying to compare Glove, Fasttext, Bert on the basis of similarity between 2 words using Pre-trained Models. Glove and Fasttext had pre-trained models that could easily be used with gensim word2vec in python.
  
  > **Does BERT have any such models?**
  >
  > **Is it possible to check the similarity between two words using BERT?**
  
  **Tags:** natural-language-processing, bert, similarity
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2020-08-06. Score: 0 | Accepted answer
  
  **1. Does BERT have any such models?**
  
  If you mean the **pretrained model**, then the answer is YES.
  BERT has Cased and Uncased models and also models for other language (`BERT-Base, Multilingual Cased` and `BERT-Base, Multilingual Uncased`, trained in 104 languages). You can check those models [here](https://github.com/google-research/bert#pre-trained-models).
  
  **2. Is it possible to check similarity between two words using BERT?**
  
  Refer to [this Google Colab Notebook](https://colab.research.google.com/drive/1ZQvuAVwA3IjybezQOXnrXMGAnMyZRuPU#scrollTo=BokW7CAgMxCB), it is **not appopriate** with BERT Embeddings for **Word-Level similarity comparisons**.
  
  However, doing **sentence embedding similarity comparisons** are still valid with BERT.
  
  That's it, hope it helps you :)
  
  
  ---
  
  