Besides setting the random seed, you should also disable non-deterministic cuDNN operations, if you are using the GPU.
Have a look at the docs regarding reproducibility 4.
Note that you might lose some performance enabling deterministic behavior.