Just to mention that I’m also running into an error on the 2080ti but not on a K40 when using pytorch 1.0. It’s using the same code, environment. The only difference is it breaks on the 2080ti and throws an error
Traceback (most recent call last):
  File "/home/henrye/downloads/Henry_OpenNMT-py/train.py", line 120, in <module>
    main(opt)
  File "/home/henrye/downloads/Henry_OpenNMT-py/train.py", line 51, in main
    single_main(opt, 0)
  File "/home/henrye/downloads/Henry_OpenNMT-py/onmt/train_single.py", line 131, in main
    model = build_model(model_opt, opt, fields, checkpoint)
  File "/home/henrye/downloads/Henry_OpenNMT-py/onmt/model_builder.py", line 301, in build_model
    model = build_base_model(model_opt, fields, use_gpu(opt), checkpoint)
  File "/home/henrye/downloads/Henry_OpenNMT-py/onmt/model_builder.py", line 294, in build_base_model
    model.to(device)
  File "/home/henrye/anaconda3/envs/pytorch/lib/python3.6/site-packages/torch/nn/modules/module.py", line 381, in to
    return self._apply(convert)
  File "/home/henrye/anaconda3/envs/pytorch/lib/python3.6/site-packages/torch/nn/modules/module.py", line 187, in _apply
    module._apply(fn)
  File "/home/henrye/anaconda3/envs/pytorch/lib/python3.6/site-packages/torch/nn/modules/module.py", line 187, in _apply
    module._apply(fn)
  File "/home/henrye/anaconda3/envs/pytorch/lib/python3.6/site-packages/torch/nn/modules/rnn.py", line 117, in _apply
    self.flatten_parameters()
  File "/home/henrye/anaconda3/envs/pytorch/lib/python3.6/site-packages/torch/nn/modules/rnn.py", line 113, in flatten_parameters
    self.batch_first, bool(self.bidirectional))
RuntimeError: cuDNN error: CUDNN_STATUS_EXECUTION_FAILED