I was wondering if instantiating a model inside a loop would reset the params in each instance of the model.
For example if we had something like the following:
for iter in range(5):
model = Model()
optim = torch.optim.Adam(model.parameters())
Some initial experimentation indicates that the above is true but just wanted to verify this from the devs or community experts.
Thanks!