PyTorch doesn't free GPU's memory of it gets aborted due to out-of-memory error

CTRL+Z suspends the current foreground process via SIGTSTP and doesn’t kill it.
You can return the process to the foreground via fg process_name.
It’s thus expected that the memory is not released.

where’d you get those K80s?

It is probably the ec2 instance p2.8xlarge