I want to recreate this paper and I was wondering how do I extract ReLU
outputs of EfficientNet and Inception models?
I read about the models and ReLU
isn’t an explicit layer but a part of the convolution layer. I want to confirm if just using the CNN output would be appropriate for this purpose.
Moreover, EfficientNet uses SiLU
instead of ReLU
. So what should I do in that case?