ReLU function in THNN/generic?

#1

There are various ReLU functions defined in THNN/generic, e.g.

LeakyReLU.c
PReLU.c
RReLU.c

it doesn’t look like plain ReLU is defined here and I can’t seem to find a c-routine to link in the library, e.g.

nm -j libAten.dylib | grep Float|grep ReLU | grep updateOutput
_THNN_FloatLeakyReLU_updateOutput
_THNN_FloatPReLU_updateOutput
_THNN_FloatRReLU_updateOutput

what is the underlying c-routine that is called for simple relu?

thanks.

#2

I think I see, ReLU is implemented as a specific call to Threshold

THNN/generic/Threshold.c

nm -j libATen.dylib|grep Threshold|grep Float
_THNN_FloatThreshold_updateGradInput
_THNN_FloatThreshold_updateOutput