How to do inverse transformation in the test image data

No, the transformations do not track their randomly samples arguments, but you could track them manually and by sampling the random arguments first and then by applying them with the functional transformation API.
This post gives you an example how this API can be used.