Run slower when using autocast with small batch size

I see. Thanks a lot!