Finetuning error: RuntimeError: Error(s) in loading state_dict for GPT2LMHeadModel: Missing key(s) in state_dict: “transformer.h.0.attn.masked_bias”, “transformer.h.1.attn.masked_bias”
# ❓ Questions & Help

<!-- The GitHub issue tracker is primarly intended for bugs, feature requests,
     new models and benchmarks, and migration questions. For all other questions,
     we direct you to Stack Overflow (SO) where a whole community of PyTorch and
     Tensorflow enthusiast can help you out. Make sure to tag your question with the
     right deep learning framework as well as the huggingface-transformers tag: 
     https://stackoverflow.com/questions/tagged/huggingface-transformers 
     
     If your question wasn't answered after a period of time on Stack Overflow, you
     can always open a question on GitHub. You should then link to the SO question 
     that you posted.
     -->

## Details
<!-- Description of your issue -->

<!-- You should first ask your question on SO, and only if
     you didn't get an answer ask it here on GitHub. -->
**A link to original question on Stack Overflow**:

I think we're missing some info here, can you add your complete code snippet to the issue's title? 

### 🤣🤣 

You can even add some binary data in there for good measure.

Hehe I'm just kidding :trollface: <|||||>Managed: I just didn’t account for the May 7 transformers release! 

Sent from my iPhone

> On 12 May 2020, at 2:08 PM, Julien Chaumond <notifications@github.com> wrote:
> 
> ﻿
> I think we're missing some info here, can you add your complete code snippet to the issue's title?
> 
> 🤣🤣
> 
> You can even add some binary data in there for good measure.
> 
> Hehe I'm just kidding 
> 
> —
> You are receiving this because you authored the thread.
> Reply to this email directly, view it on GitHub, or unsubscribe.
<|||||>The same issue in Colab. I use DialoGPT repo but issue is the same<|||||>Help, please . Anyone. I can't load on other devices. I have copied the model from the device where it was trained on GPU, now I cannot load on other device with CPU.<|||||>It's hard to help with this much information. Can you open a new issue, respecting the template, letting us know what's your issue?<|||||>https://github.com/huggingface/transformers/commit/05deb52dc170226fcad899c240ee9568986d8d5a#diff-8530ad4c95b70580d10d594b7411a8be seemed to break this pretrained model, which was last modified on February 18.  There masked_bias was introduced.  Try reverting to a version before that, like cec3cdd.