How to optimize multi model's parameter in one optimizer

[ptrblck]

Seems to be this issue. Let’s keep the discussion in the other thread to keep this one clean.