I don’t think thee Actor itself is causing the issue as it should then also fail in isolation. I would however speculate your training code and the interaction between both models as well as the section updating parameters etc. might cause the error.
You could take a look at e.g. this topic to understand when stale forward activations could cause issues.