how to check that there is a residual connection in network from network definition without accessing forward function.
You could try to print the graph as described here.