Same issue here when following the Fine-tuning a masked language model 3 tutorial with a GPU Colab instance, which installs transformers v4.12.5 and torch v1.10. Could this be linked to the installation of pytorch from a TPU wheel https://storage.googleapis.com/tpu-pytorch/wheels/torch_xla-1.9-cp37-cp37m-linux_x86_64.whl 2 in the first cell?
EDIT: opened an issue in the notebooks repo: `undefined symbol` error when running chapter 7 notebooks on a GPU instance · Issue #120 · huggingface/notebooks · GitHub 9