To apply the same random transformations, you should use the functional API. Have a look at this post for an example.