It seems the ProtBERT checkpoints use the bert architecture so you can use them with BertForSequenceClassification.
In general you can just try AutoModelForSequenceClassification.from_pretrained(checkpoint_name) and it will return an error if there is no sequence classification model in the library for the architecture you are using with checkpoint_name.