What should I use for declaring a layers __init__()?

I think it depends on your use case and eventually also depends on your coding style.
E.g. if you plan to replace specific layers later, using the module approach might be easier than manipulating the forward method. This post explain the different approaches in more detail.

1 Like