How to update nonoverlapping parameters using different loss?

autograd
1

I have a network like this:

0
03120×4160 2.67 MB

How can I update Ebedding and CNN layer according loss1 and update parameter W according loss2?