Optimizing CUDA memory pipeline for RNN

Hi,

Thank you for your answer.
I will follow your suggestion, tomorrow or in the next few days I will put here peaces of the code to make things clear.
Hope you will still be available to take a look.

What you mean by

if you are not explicitly detaching your hidden state when you move on to the next sentence

???

Thank you again