Cuda Streams in C++ Lib?

[litttl]

Could you give me some advise?Thanks very much

Help on using stream in multithread to accelerate

I need some help about using stream in multithread to accelerate my computation. Could you help me and give me some advise? my problem: the time killed by using multithread and multistreams is seem to using serial loop. it doesn’t speed up. my codes: I used a thread-pool with 10 threads. I add my task into threads. In thread task funciton, I get a free GPUStream and do some job in this GPUStream. the thread task is as follow: void* task_thread(void** arg) { auto options = torch::TensorOp…