Is BatchNorm layer supporting double backward in the master branch now? How about InstanceNorm? Where to find already supported double backward operation list?
Agree, it would be very helpful to have a list of operations that either support or do not support double backward. It would be great to know especially for batch norm.