@tom, do you know of any activation function whose inverse has output range (0, inf)? I am trying to generate values that are always greater than zero, so when inverting the output of the generated value, I don’t want the logit for example to map sigmoid outputs < 0.5 to negative numbers