You are right. Data leak might be wrong. Instead you’ll get biased estimates of your test accuracy, since the validation data was already touched.
What is your metric to see if your results are better?
Usually you would check the ROC with various thresholds to see where to cut off.