I’m wondering how to train a model with another pre-trained model.
Say I have a pre-trained model (model2) which takes input as the shape of (batch, 365, 15), and I have another model (model1) generate the output as (batch, 1, 3). I wanna use these outputs to serve as the input to my pre-trained model. What is the proper way to concatenate the inputs to my pre-trained model? Now I have zero gradients with the following code.
out = model_1(someinputs) input[:, :1, 0] = out[:, :, 0] input[:, :1, 5] = out[:, :, 1] input[:, :1, 10] = out[:, :, 2] y_hat = model_2(input) calculate loss gradient turns None.
I’m feeling this is not a proper code but could someone suggest a better method?
Thank you all.