Thanks a lot!
So, this expression does not break the computation graph and gradients are properly back propagated as intended (zero for the low loss, normal for the remaining)?
I thought I need to use one of those selection functions so that it is differentiable.
I wonder how it is achieved in such cases.
And in general, which ops/functions are diff and which are not.
Do you know of some doc or blog post that explains these in some detail?