Hey @smth
So I compared the weights and activations from of pytorch and lasagne VGG16 models converted from caffe. They are the same.
My custom model has dilation layers and they are the ones which are resulting in different activations. Still investigating.