Switchable Normalization

1

I recently came across switchable normalization in Andrew Ng’s ‘The Batch.’ Is this a layer that can be plugged into an existing model for normalization purposes? If so, is there a pytorch implementation of it?

2

A version here: https://github.com/switchablenorms/Switchable-Normalization/blob/master/devkit/ops/switchable_norm.py

1 Like