AMP: How to check if inside autocast region?

[hughperkins]

AMP: How to check if inside autoscaling region?

[ptrblck]

You can if autocasting is enabled via torch.is_autocast_enabled().