DQN pyorch q values

1

Hello,

I am implementing DQN for Reinforcement learning in pytorch

I am getting for all actions the same Q Values for different states and actions

What could be the reason ?

Thank you for your help