Yes, CS224N is a great course for NLP with Deep Learning. The run of 2019 (available on YouTube) doesn’t cover Transformers in great detail, but there is a great lecture by Vaswani himself (Lecture 14).
More info on transformers-like models in another Stanford course, CS224U, is also available on YouTube.