Multi CPU Parallelism

Because of the nature of the data I cannot load the data as a batch and send it GPU so I have to send them one by one to a CPU. How can I use several CPU’s and make them parallel so I can load my data simultaneously into all of the CPUs?