The logs say that a TFDistilBertModel is being initialized with a TFDistilBertForSequenceClassification checkpoint so it is normal that the dropout and classification layers are ignored, thus the logs are raising a proper message. The bug should be in the pipeline itself.