Visualize Convolutional layer of Alexnet

You could use forward hooks to get the activation maps and visualize them as described here. The topic also includes another post to visualize kernels.