I want to design two networks and update them separately, but some of their layers are the same.
I have two plans. Can you tell me which one is better or give another better idea?
- Use two nn.module. Change the weights of the same layers of A network after B network updates.
- Use one nn.module. In this situation, A and B can use the same layers.