Saving extracted features

You could use forward hooks as described in this post. Alternatively, you could also just return each activation in the forward method.