How to change size of filter in torch model

No, It would not change the structure of the network.

Anyhow, replacing a layer or removing would definitely change the intermediate structure of the network.

There are a lot of tutorials about removing the layers. Follow here