How to use nn.ModuleList() correctly

There is no connection between each of the Module that you stores in ModuleList because ModuleList is just like a Python list.

You should check out this thread for more detail