you can give different learning rate for each denseblock by using the following code
opt=optim.SGD([{'param':model_densenet.features.denseblock1.denselayer1.parameters(),lr=0.01},
{'param':model_densenet.features.denseblock1.denselayer2.parameters(),lr=0.05}],momentum = 0.9,nesterov=True)