wrong configuration of ALBERT xlarge
# 🐛 Bug

## Information
If you are **reproducing** the  [ALBERT](https://github.com/google-research/albert), the `num_attention_heads` of albert xlarge should be 32 instead of 16 as
https://github.com/huggingface/transformers/blob/db9279dedbb9c5e7d24569a1ac3f74f9d5c3eb18/src/transformers/configuration_albert.py#L27

Where did you get 32 from?

The [official file ](https://tfhub.dev/google/albert_xlarge/2)says 16.<|||||>Well, the model configuration in tar file downloaded from TF Hub shows 32, which conflicts with the official definition.<|||||>Indeed, that's right. I'll follow the issue you opened https://github.com/google-research/ALBERT/issues/180 and act accordingly.<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
