Yes loss decreased after first epoch but after Second Epoch, it just got stuck at either predicting ones through out or predicting zeros through out. Also about deleting the tensors, It is for working cost, i want to delete the values from the memory so they don’t use up space on the ram while it is running.