I’m using Opacus and I have a very specific question
Basically, I want to alternate the training using differential privacy with the training without DP:
- I wrap the model with make_private and I train this “private model” for some epochs
- Then I want to unwrap the model and restore the original one to train a “non private model” without differential privacy
Is it possible to do this? Can I restore the original model after I wrapped it using make_private?
I also have another question, assuming that it is possible to unwrap the private model, is it possible to alternate the training of the private model with the training of the original model without calling every time make_private?
Thank you and sorry for the “strange” question.