Frozen Model is Affected by Optimizer

vision
1

I have a trained a CRNN model containing LSTM, batch norm and convolutional layers. Using the trained model I’m trying to train the input of the model. (Trained model is loaded from the disk)

image = torch.rand(1, 1, input_size[0], input_size[1]).cuda()
loss_function = CTCLoss().to(device)
optimizer = optim.Adam([image.requires_grad_()], lr=lr)

Image is saved after training. This saved image generates a different output with a newly loaded model than the model used to train it. By using a single image I discovered that this difference happens only if optimizer.step() is called.
Am I missing something here? Does optimizer change the model even this case? (I haven’t included model params in optimizer)

2

Hi,

I am not getting what you are trying to achieve by “I’m trying to train the input of the model.”. When optimizer.step() is called, the gradients are accumulated to image tensor which changes the value of the tensor. So I am guessing that your input (image tensor) is getting changed and not your model.

3

I’m trying to do something similar to this tutorial.
Basically my intention is to find the optimal image expected by the model, given a label.

" So I am guessing that your input ( image tensor) is getting changed and not your model."
This is exactly what I want. But it appears that it changes the model as well. That’s the problem I’m having.

4

Hi,

I understood your problem, but it’s hard to tell with just three lines of code. You can debug your optimizer by checking opt.param_groups, it will give you all the parameter it tries to optimize. Hope this helps.

5

Thanks. I will try that and post the results if I find anything weired in there.

6

I figured out the issue here. CRNN model has two batchNorm layers. They behave differently in train and eval modes.