As far as I understand the issue, it seems that you are seeing a discrepancy between the validation and test accuracy?
If so, could you post the validation code so that we could search for some differences?