on pytorch-master, we have been converting several loss functions to have a reduce=False argument that returns non-summed losses. That’s what you are looking for. BCE hasn’t been converted yet. Ping @richard to ask him to prioritize it up and get it done next week: https://github.com/pytorch/pytorch/issues/264#issuecomment-340011845 4