Could you lower the batch size and see, if you might hit an our of memory issue?
Cublas might try to create the handle (and workspace) internally and might be running out of memory.
If that’s not the case, could you post the model definition as well as input shapes, so that we could take a look at it?