Clearing the GPU is a headache

[Saifeddine_Barkia]

@ptrblck sir, I have the same problem here, can you help me determine where I put the cuda. empty_cache()?

RuntimeError: CUDA out of memory?

Check the attention_maps and raw_features, as well. If they are not scalers, and they do not participate in the training (contribute to it, and you are just using them as pure outputs) considert doing a detach() on them as well.