Output of actor is (almost)same for different states

[vmoens (Vincent Moens)]

@nsidn98

Expected output by the actor: [x,y]: a 2-dimensional vector according to the state. Here x is expected in the range [0,160] and y is expected in the range [0,112]

Different types of modifications tried with the input:

You’re using batch norm so it is expected that after initialization the output is roughly the same.
If you use batch norm and apply an affine transform to your image, the result will be the same.
Aside, using batch norm in RL is not always a great idea as you may loose some “temporal” information about your data. It is not a common thing to do.
Check our ConvNet in torchrl for a quick implementation