Answers.Body: <p>LASER creates multilingual contextualized word embeddings, what you do with them is up to you. You can use this as a feature extraction and add whatever you want to the end of the network.</p>
  <p>I believe the implementation by facebook does not let you change the weights of the LASER model itself, they are froozen to the best of my knowledge.</p>
  <p>So, yes, you can use LASER for downstream tasks, but you cannot change the actual weights of the LASER model.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-03-22T09:25:04.153Z
Answers.LastActivityDate: 2021-03-22T09:25:04.153Z
Answers.UserDisplayName: Isbister
Body: <p>Can <a href="https://engineering.fb.com/2019/01/22/ai-research/laser-multilingual-sentence-embeddings/" rel="nofollow noreferrer">Facebook's LASER</a> be fine-tuned like BERT for Question Answering tasks or Sentiment Analysis?</p>
  <p>From my understanding, they created an embedding that allows for similar words in different languages to be close to each other. I just don't understand if this can be used for fine-tuning tasks like BERT can.</p>
  
Tags: <deep-learning><natural-language-processing><sentiment-analysis><question-answering><fine-tuning>
Title: Can Facebook's LASER be used like BERT?
UserDisplayName: user1234
ThreadText: # Can Facebook's LASER be used like BERT?
  
  (Asked by: username_0 on 2021-03-18)
  
  Can [Facebook's LASER](https://engineering.fb.com/2019/01/22/ai-research/laser-multilingual-sentence-embeddings/) be fine-tuned like BERT for Question Answering tasks or Sentiment Analysis?
  
  From my understanding, they created an embedding that allows for similar words in different languages to be close to each other. I just don't understand if this can be used for fine-tuning tasks like BERT can.
  
  **Tags:** deep-learning, natural-language-processing, sentiment-analysis, question-answering, fine-tuning
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2021-03-22. Score: 1
  
  LASER creates multilingual contextualized word embeddings, what you do with them is up to you. You can use this as a feature extraction and add whatever you want to the end of the network.
  
  I believe the implementation by facebook does not let you change the weights of the LASER model itself, they are froozen to the best of my knowledge.
  
  So, yes, you can use LASER for downstream tasks, but you cannot change the actual weights of the LASER model.
  
  
  ---
  
  