I have trained a CNN model with softmax classification layer. Now, I want to get the class activation maps (CAM) from these trained model on some test-samples. I have found a code that does this using Keras, but cannot do the same thing in PyTorch.
In this Keras code, they compute the gradients of the predicted output with respect to the last convolutional layer. So, I wonder how I should compute these gradients in PyTorch.
Here is the full Keras code:
preds = model.predict(image) class_idx = np.argmax(preds) class_output = model.output[:, class_idx] last_conv_layer = model.get_layer("mixed10") grads = K.gradients(class_output, last_conv_layer.output) pooled_grads = K.mean(grads, axis=(0, 1, 2)) iterate = K.function([model.input], [pooled_grads, last_conv_layer.output]) pooled_grads_value, conv_layer_output_value = iterate([image]) for i in range(2048): conv_layer_output_value[:, :, i] *= pooled_grads_value[i] heatmap = np.mean(conv_layer_output_value, axis = -1) heatmap = np.maximum(heatmap, 0) heatmap /= np.max(heatmap)
Any help is appreciate!