I found the problem in my case. The GPU used to perform the experiment were different in Optuna and when I ran it on my own. Check which GPU was used during optimization to perform the experiment, maybe that’s the case for you as well.
Best of luck