Does pytorch support finite difference differentiation for optimizers like ADAM?

[Zohim_Chandani]

Does pytorch support finite difference differentiation for optimizers like ADAM?

[ptrblck]

Are you trying to differentiate the optimizer itself?