Is it possible to limit driver_allocated_memory

I’m using sentence-transformer to turn strings into sentences with mps enabled. I noticed that driver_allocated_memory grows as I process more strings which I don’t quite understand. This behaviour doesn’t exist when mps is disabled

Is there a way to limit the driver_allocated_memory for a process?