There are various ReLU functions defined in THNN/generic, e.g.
LeakyReLU.c
PReLU.c
RReLU.c
it doesn’t look like plain ReLU is defined here and I can’t seem to find a c-routine to link in the library, e.g.
nm -j libAten.dylib | grep Float|grep ReLU | grep updateOutput
_THNN_FloatLeakyReLU_updateOutput
_THNN_FloatPReLU_updateOutput
_THNN_FloatRReLU_updateOutput
what is the underlying c-routine that is called for simple relu?
thanks.