Is it OK to change dataset during training?

2

No, if you are using multiple workers, the changes won’t be reflected.
What is your use case?
Maybe you could use shared arrays?