Hi I don’t know if this’ll help but I found that in order to do xavier_uniform one should do:
linear1=torch.nn.Linear(N_FEATURES, hiddenLayerSize, bias=True)
torch.nn.init.xavier_uniform(linear1.weight)
instead of:
nn.init.xavier_uniform(m.weight,gain=nn.init.calculate_gain(‘relu’))
It’s discussed here: How to initialize the conv layers with xavier weights initialization?