Whats the correct max split size to set in google colab when the gpu reserves >> trying to allocate?

So I got this error message
If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
Reserved is 37 GB and allocate was 600 MB.

So imho this fits the >> case?

I tried setting to 512 and 256 and 64 but I still get the same error.

Does anyone have experience on how to set this correctly?

Many thanks in advance!