Did you build c++ from source ? If so I would make sure you included cuDNN (make sure it compliments your cuda version) and mkl for your build. Using 1.3.0, I get a 5-6X speed up. Would imagine this would be similar in 1.5.0, if not better