Thank you for your commenting. I am looking around the ELF code and  raised this question (since nn.L2Loss exist in PyTorch). It seems Q_learning class in the ELF is just a prototype (since this is not documented rlpytorch etc.)