Yeah, basically I need to ‘recreate’ a new BN module, or go through all the BN layers to set bias=None
after creating the network, which is not very elegant.
I wonder is there any plan of adding this switch directly into BN params? @Soumith_Chintala @apaszke