Hello, I want to do some experiments with weight normalization and I was wondering if it would be possible to set the g in weight normalization as 1 or a different function of time in PyTorch.
Thank you in advance!
Hello, I want to do some experiments with weight normalization and I was wondering if it would be possible to set the g in weight normalization as 1 or a different function of time in PyTorch.
Thank you in advance!
I believe this might be working: net.fc1.weight_g = nn.Parameter(torch.Tensor(1))