getting random results when running run_glue
Hi
I am running run_glue.py script on RTE dataset with BERT base model, on different gpus and I am getting very random results, like changing a lot by changing the gpu. I am using python 3.6 and transformer version 2.5.0. I tried with two gpu types like 
Kepler , GTX1080ti and P40, ...
such randomness really affects the benchmarking and appreciate your help. thanks
I have a deadline and appreciate your prompt response.
thanks.
Best
Rabeeh
Hi
Any comment on this?  I also tested with these versions, run_glue with BERT gets fully random results. Like this I cannot run experiments, could you please have a look?
 
python                    3.6.9                h265db76_0  
pytorch                   1.2.0           py3.6_cuda10.0.130_cudnn7.6.2_0    pytorch
torchvision               0.4.0                py36_cu100    pytorch
transformers              2.5.0                     <pip>

thanks
<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
