Stonepia:

what is the point of moving it out of cuDNN implementation?


The advantages are mentioned in the PR:

faster, especially for backward (see: things/conv-backward-profile.md at master · zasdfgbnm/things · GitHub 3)
handles 64bit indexing automatically
has less code, less maintenance effort




 Stonepia:

The thing is , I could not find a place telling me how to handle the bias (or should I handle it manually?)


If you want to copy the current approach used in PyTorch, you could add the bias manually as seen here 2.