Different results when using caffe and pytorch

[dashesy]

I ended up with this implementation of Caffe SGD. Appreciate if you can take a look.