Graph representation of PyTorch model during forward and backward passes

Hi! If you have ever played with a graph related to PyTorch model could you, please, share what tools did you use?

  • To build forward / backward graphs? To build A joint graph for both forward and backward?

  • To access and modify nodes/subgraphs?

  • To generate forward/backward pass given model graph?

Thank you!