How large are these differences and are you also seeing them using the same approach?
If so, you might be facing non-deterministic results, if you use e.g. cudnn benchmarking etc. due to the limited floating point precision.