Is there a way to create the new CNN models with SyncBatchNorm, in torchvision.models, apart from using the convert_sync_batchnorm function?
And, is there a simple way to convert the trained models back to regular batchnorm, for backward compatibility?