Visualize activation layer

vision
2

You could use forward hooks to grab all activations from all layers and visualize it afterwards as described here.
Let me know, if that would work for you.