@ezyang’s post on PyTorch internals 12 might be a good starter to get some ideas about how to contribute.
Also @tom recently published a post and video about fixing your first PyTorch bug 10.
I would generally recommend to have a look at the usability / simple-fixes category in the issues 2.