Federated Learning

Hi all,
I am new to deep learning and pytorch. Really struggling. I need to implement federated learning on BreakHis database for cancer prediction. I implemented using VGG19 and only getting accuracy of 56%. Any one can help to increase the accuracy and debug my code?