Excluding AdamWeightDecayOptimizer internal variables from restoring
I tried to use  convert_tf_checkpoint_to_pytorch.py script to convert my pretrained model, but in order to do so, I had to make some minor tweaks. I thought I would share in case you find it useful. 
Is your pre-trained model a TensorFlow model?<|||||>Yes<|||||>Nice, thanks for that!