In the Handling multiple sequences page of Chapter 2, there is a bug in the code under Attention masks section.
Page: Using 🤗 Transformers - Hugging Face Course 8
The PyTorch toggle is on, but the code uses Tensorflow’s tf.constant function.

Screenshot from 2021-06-15 16-57-42970×796 70.6 KB



There is a typo on https://huggingface.co/course/chapter2/6?fw=pt 1

Screenshot from 2021-06-15 17-12-37917×347 39.9 KB



Isn’t wordpiece a subword algorithm as well?

image976×517 38.6 KB