In the first example self.actor_nn and self.critic_nn will both share the same base_nn module in their Sequential blocks while you have removed the shared module and seem to use it as a standalone module via self.nn in the second approach. Both approaches should have the same number of parameters.
1 Like