Gradient calculation when module used multiple times (e.g. siamese network)

2

the gradients are summed (i.e. accumulated).

3 Likes