Yes, in modern nlp, the models are pre-trained  using unspervised objective (maksed lanaguge modeling, auto-regressive LM, document denosing etc).
And the downstream tasks (classification, QA) etc are supervised. Again, the above resources should help you understand the difference better.