@apaszke I’ve been playing with finetuning vs freezing everything but the last layer, but I find that there is no much difference in the training time (17min finetuning vs 16min training last layer) in Simpsons dataset, whereas the accuracy is quite different (91% vs 62%). Here you have the code and details. I tried other datasets with similar results.
Shouldn’t the freezing example be much faster?