Resnet/Alexnet memory usage

I was training on ImageNet using AlexNet and I used a batch size of 256. It used about 2000mb of Cuda memory. However, when I switched the network to Resnet50, the Cuda memory usage increased significantly; and a batch size of 120 already used about 10000mb Cuda memory. Is it normal?