I like PyTorch, but I found that it still lacks some if not many useful and reliable tools/libraries/solutions, in certain areas. The aim of this post is to encourage people to list the areas in which PyTorch still doesn’t provide reliable, complete, elegant and “production-ready” solutions.
Here are a few of them

k-fold cross-validation (see e.g. What is the best way to apply k-fold cross validation in CNN? 14)
Hyper-parameter optimization (see e.g. What is the best way to perform hyper parameter search in PyTorch? 9)
Visualization tools (https://nbro.github.io/blogging/2019/01/06/an-example-of-how-to-use-visualdl-with-pytorch/ 6)