Dynamical automated architecture search

I am trying to figure out how to add layers to a model dynamically. I have this custom GA that does optimization with respect to weights. I want to be able to optimize for topology as well. I have looked at this post. Second answer contains a way of deleting layers dynamically, but not adding.

I have also seen a couple of posts with this implementation, but I do not fully understand it. I don’t see how these allows augmenting the NN architecture.

The closest I got is this blog post. I am working on it right now. If you have suggestions that worked well for you, please, share!

Thanks in advance!