How to set a good learning rate when using sync bn?

i’m using mmdetection and detectron. when i use mmdet and my own face data to do face detection task, I find the learning rate is hard to set. once the batch size is bigger than 4 (2 img per gpu and 2 gpus), it’s hard to learn a good result. So do you have any learning rate tricks or related suggestions to do it? thanks!