Many thanks for your reply!
I will try to use different seeds and self.SP architectures to do some experiments, and report the results later.
Not mentioned above, different self.SP architectures cause different final accuracy drops! I think this observation also results from the symptom that you had mentioned, which mainly related to pseudorandom number generator)