With such extreme changes, I guess the number of test samples are very few, so a small change in model can cause a large change in performance.
Can you add more info, what model, how are you training, what is the training and the test set statistics?