Different performance between pip install vs. download zip code
## ❓ Questions & Help

<!-- A clear and concise description of the question. -->
Hi guys,
I meet a weird  problem. Basically I am using BERT for sentence pair classification, such as MNLI, RTE tasks.

I installed the pytorch_transformers by "pip install pytorch-transformers" and 

> from pytorch_transformers.modeling_bert import BertForSequenceClassification

everything works fine, the performance on RTE can reach 70%.

Instead, I downloaded the zip code to local since I want to do some modification about the BertForSequenceClassification in my future projects. (let's say I renamed the unzipped folder into "my_pytorch_transformers"), and now import as:

> from my_pytorch_transformers.modeling_bert import BertForSequenceClassification

Now, everything was not the same; the performance was just 53%, and it showed difference from the beginning of iterations.

So, what's wrong here?  I thought maybe some initializations are different between the default installation and my local code?  But I always used the pretrained BERT "bert-large-uncased", ....I can not figure out where the difference comes from.

Thanks for any hints










sorry I found the problem: the pip source code and the zip code downloaded are different, especially for the "BertForSequenceClassification" class