R2D2 in PyTorch

Hi, does anyone have an R2D2 example for PyTorch? Preferrably pong or some basic env? Would love to see a small efficient implementation

Did you check rlpyt? You can check this too. If you know another clean implementation, I’m interested to know too.
Thanks.