I’ve had no problem implementing this idea in tensorflow. The reason i want to move to pytorch is:
It’s awesome dataset api and easy multi-gpu training.
I can also share a tensorflow example if that helps you understand the algorithm better.
I would be most grateful if you could help me solve this issue.