How do I backpropagate through a module's parameters?

A solution for your minimum example without involving external lib.

https://discuss.pytorch.org/t/non-leaf-variables-as-a-modules-parameters/65775