As a followup: I submitted a fix in Fix conv_transpose3d backward with non-contiguous grad_out by t-vi · Pull Request #67829 · pytorch/pytorch · GitHub 3 . It should show up in the nightly builds shortly after it will be merged.
Again, thank you for submitting this with an easy test-case.
Best regards
Thomas