I have two CNNs where each CNN runs on a different dataset. The output feature vectors of these CNNs (basically without the last fc layers) are concatenated and given to a classifier. How do I train such a network?
How do I train such a network?
what are you exactly looking for? a pointer or a full blown example?Generally, you can write your autograd expressions in free form and call backward on the final loss of the classifier.
I didn't realize that my Net class could take 2 inputs and have two parallel networks inside it in free form. Thank you for the help xD