Parameter-Efficient Fine-Tuning for CNN

Dear community,

  1. Is there some Parameter Efficient Fine-Tuning technique like LORA(low rank adaptation) is available for CNN to reduce the GPU memory usage while training/fine-tuning the network?

  2. Is it possible to apply LoRA for CNN kernels which will be of (3X3, 5X5, 7X7)?

Any article recommendations will be highly helpful. Thanks

1 Like

It seem like Microsoft has written LoRAConv layer, you can find it here.

1 Like

I implemeted a ton of PEFT methods for both CNNs and ViTs. Check my paper here - [2305.08252] Parameter-Efficient Fine-Tuning for Medical Image Analysis: The Missed Opportunity