I am running PPO , with CUDA on a GPU I saw that the steps are not in the sequential order
Is this because of parallel processing or something is wrong.
I have seen that many steps are repeating in different order ? can anyone help me .Thank you
Could you post (pseudo) code which shows how these operations are applied?
1 Like
Hi sorry I forgot to close this issue it was an error with notebook I was using it was printing everything twice.Thank you for your response.