What initialization is torch.nn.Sequential using?


(Brando Miranda) #1

I was using

    mdl_sgd = torch.nn.Sequential(
        torch.nn.Linear(D_sgd,1)
    )

but wanted to know the scale of of its random initialization and if its random or uniform.


(Moskomule) #2

Hi, see the code, it uses random variables from uniform(-stdv, stdv).


(Brando Miranda) #3

how did find this out?