How to achieve high precision?

You have data imbalance problem, to alleviate that, You can,

  1. Use weighted Cross Entropy loss. Or
  2. Use WeightedRandomSampler() , see this post for more clarification.

After that you can experiment with different optimizers, and learning rates by using learning rate schedulers.