thanks @ptrblck  for responding, and it is similar, though my batches has ~2^25 elements which is less than 2^31
Is CUDA really much slower that cudnn? by how much?
because if this is the difference is small enough maybe this walk-around should be posted somewhere more noticeable in the meanwhile.