Why the training slow down with time if training continuously? And Gpu utilization begins to jitter dramatically?

[ptrblck]

Is this issue solved here or is this unrelated?