I think I see, ReLU is implemented as a specific call to Threshold
THNN/generic/Threshold.c
nm -j libATen.dylib|grep Threshold|grep Float
_THNN_FloatThreshold_updateGradInput
_THNN_FloatThreshold_updateOutput