The default is evaluation_strategy="no", yes, as is clearly documented in the TrainingArguments 5. Evaluation in NLP often takes a long time (as in the question-anszering, translation, summarization scripts for instance), which is why there is that default.
If you want to evaluate after training, just run trainer.evaluate()