Hi,
Thank you for the quick reply.
I made the changes as you said but I am still getting a fluctuating loss pattern.
I have also updated my first post to reflect my latest architecture and code.
I am using PyTorch 0.4.1.post2.