I tried to initialize the weights and bias of AlexNet exactly as described in the paper. Is this the correct way to do it?
Initialize weight and bias
def initialize_weights(m):
for layer_count,layers in enumerate(m.children()):
if isinstance(layers, nn.Conv2d):
nn.init.normal_(layers.weight, mean=0, std=0.01)
nn.init.constant_(layers.bias, 0)
if layer_count in [1,3,4,5,6]:
nn.init.constant_(layers.bias, 1)