I have the impression that something is shifting the random state in your pipeline, but I can not be sure, you can check this deactivating the shuffle in trainning dataset (in both pipelines). I do not have more ideas at this moment, I am sorry  Maybe someone else can give a hint to you.