Hi everyone
I have a question about BERT
I want to bert to encode short desc and long desc instead of lstm and cnn. on the web, I just find something about BertForSequenceClassification this model and in this model, it needs to have a label, but in my dataset, there hasn’t label and only have data pairs such as A and B are similar. in my ideas, I just want to use bert mode and fine-tuning and use the same loss function. here is the structure of the model and here is the loss function! here is my code!
Screen Shot 2020-12-18 at 1.00.19 PM1764×929 287 KB
I do not sure what I read is right or not, but the result is not improved.
anyone can help me?
thanks a lot