Parallelising expert execution on single GPU using CUDA streams

[ptrblck]

@Shamauk

GPUs are massively parallel and I would expect it have no problem running an extra matrix multiplication at the same time.

This post might be helpful explaining the memory and compute resources in the attached GTC talk.