Using a frozen model right before the output?

Does it make sense to have a frozen model right before the output and update earlier parameters?

I am training a model like:

input -> FC layers -> frozen RNN model -> binary output -> loss

I just want to update the FC layer weights. If there’s any related research or topic you can refer me to, that would be appreciated.