Gpu asynchronous and processparallel

Since gpu is asynchronous in Pytorch. Can I regard it as a process parallel?