Yes, it should work, but unfortunately doesn’t guarantee that cudnn might not hit an internal error.
Are you able to reproduce the issue by running the code snippet from the error message using this batch size? If so, which GPU are you using?