Non blocking memory transfer to GPU

[yiftach (Yiftach Beer)]

Pinned memory is page-locked - the OS cannot swap it out, see e.g.:

What is the disadvantage of using pin_memory?

Pinning memory disallows the system to use this memory for its allocations. A very simple example of an undesired behavior would be to pin too much memory, which would then force your OS into memory thrashing and moving pages into the swap thus tanking the performance of your entire system.