Sorry for the late reply! Thanks very much; the loss did go down. I made the following PyTorch forum post 7 that unfortunately gained no traction. Any chance you could have a quick peek? Many many thanks once again; you are one of the main reasons I really like the PyTorch forum