Hello again, it looks like I was mistaken.
The suggestion to use keras-bert instead still stands, but I’ve had another look at the transformers documentation and it certainly looks like it should be possible to use the google models within transformers.  See eg this issue https://github.com/huggingface/transformers/issues/3070 26.
Are you explicitly loading the google model’s config file?
What happens if you try using the first part of the pytorch conversion script to read the google model in?