Gradient Ascent and Gradient Modification/Modifying Optimizer instead of Grad_weight

4

In that case I guess you will have to create your custom optimizer to handle that. With one group for the descent part and one group for the ascent part for example.