Let me explain myself. I have to train a preTrained (on Imaganet) ResNet50 network, but instead of having one last Fc layer of 1000 I need to add 3 more FC layers (1000->128,128->64 and 64->10). I do this because i want train with a custom dataset (10 classes of my making). My code is this:
resnet50 = models.resnet50(pretrained=True) resnet50.fc = nn.Linnear( nn.Linear(2048, 1000), nn.Linear(1000, 128), nn.Linear(128, 64), nn.Linear(64, 10) )
But i dont know if I have to use a ReLU() after the last FC (nn.Linear(64, 10)).
Thanks for your help.