How to make compatible my custom env in torchrl

reinforcement-learning
1

Hi all,

I recently started to use torchrl to train an RL agent for my custom environment. I used to train agents with Rllib, but not I would like to test torchrl. My custom env is already compatible with gym and gymnasium and of course with rrlib. I tried to use torchrl for the same env, but it does not work. I wonder if anyone knows how to make a custom env in torchrl?

Thanks!

2

Can you post an issue on TorchRL with that?
Happy to make a patch if needed!
Please provide code snippet + error if possible