hi,
is there a way to further speed up the forward (in train or eval modes) of a model that has part of its layers frozen?
the freezing is done by setting:
param.requires_grad = False
BatchNorm2d_layer.eval()
Dropout_layer.eval()
the frozen layers are included in the forward.
thanks