I find that in the mode of
scale_factor is large(for example
mode=bilinear, the training process is much longer. It seems that the following operator makes training slow greatly. Has anyone observed this and tried to fix it?
model = nn.Upsample(scale_factor=16, mode='bilinear', align_corners=False) with amp.autocast(enabled=True): out = model(inp) ....