Can you share some more details of the model or a reproducible snippet that isolates the performance difference? It might also be useful to check a nvprof run to see if the same CUDA kernels are being used in 1.2 and 1.9.