What do you mean by ‘if the criterion does not have any parameters’? So far, I have only seen non-parameterized loss functions, i.e., loss functions which get some input tensors, apply loss function on those tensors and then give outputs.
Do you mean if the loss function being applied to tensors? Because I can imagine the loss function is being applied to CUDA tensors.