AttributeError: 'BertOnlyMLMHead' object has no attribute 'seq_relationship'
Is there way to fix it? 
```bash
Skipping cls/predictions/transform/dense/kernel/adam_m
Skipping cls/predictions/transform/dense/kernel/adam_v
---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
<ipython-input-11-5d7ca59bd98d> in <module>()
      7 model = BertForMaskedLM.from_pretrained(
      8     pretrained_model_name_or_path=model_folder,
----> 9     from_tf=True, cache_dir=None)
     10 #model = BertForMaskedLM.from_pretrained(model_version)
     11 

/content/my_pytorch-pretrained-BERT/pytorch_pretrained_bert/modeling.py in from_pretrained(cls, pretrained_model_name_or_path, state_dict, cache_dir, from_tf, *inputs, **kwargs)
    605             # Directly load from a TensorFlow checkpoint
    606             weights_path = os.path.join(serialization_dir, TF_WEIGHTS_NAME)
--> 607             return load_tf_weights_in_bert(model, weights_path)
    608         # Load from a PyTorch state_dict
    609         old_keys = []

/content/my_pytorch-pretrained-BERT/pytorch_pretrained_bert/modeling.py in load_tf_weights_in_bert(model, tf_checkpoint_path)
    100                 #
    101             else:
--> 102                 pointer = getattr(pointer, l[0])
    103                 '''
    104                 #J

/usr/local/lib/python3.6/dist-packages/torch/nn/modules/module.py in __getattr__(self, name)
    533                 return modules[name]
    534         raise AttributeError("'{}' object has no attribute '{}'".format(
--> 535             type(self).__name__, name))
    536 
    537     def __setattr__(self, name, value):

AttributeError: 'BertOnlyMLMHead' object has no attribute 'seq_relationship'
```
Hi,
What command are you running to load the model?
Are you loading your own model or one or our pre-trained one?

It's normal that there is no `seq_relationship` attribute in a `BertOnlyMLMHead` but our pre-trained model should load without error.<|||||>
I was loading my own pre-trained model by "convert_tf_checkpoint_to_pytorch.py". Would it be ok if I skip "seq_relationship" in the source code? <|||||>Maybe, I don't have enough information to really be able to help you at this stage.<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
