You don’t need to use a classifier on top of it as it depends on your use case.
If you want to return the features only, don’t use the additional classifier. If you want to train another stage on top of the pretrained feature extractors, add the classifier.