R2D2 in PyTorch

Hi, does anyone have an R2D2 example for PyTorch? Preferrably pong or some basic env? Would love to see a small efficient implementation