Backward pass is extremely slow

It seems you are using the CPU for the processing?
How many cores and which CPU are you using?
You could try to use MKL-DNN as described here for a potential speedup.

1 Like