Yes, in fact, the reason why there exist validation and test sets is because we are still using the information from validation . When you save a checkpoint or weights based on validation, you are taking the best model for that subset but it doesn’t mean that it’s the best model for test set.
Simply, when you validate or test you cannot use prior information from those sets.