Parameter-Efficient Fine-Tuning for CNN

vision
1

Dear community,

  1. Is there some Parameter Efficient Fine-Tuning technique like LORA(low rank adaptation) is available for CNN to reduce the GPU memory usage while training/fine-tuning the network?

  2. Is it possible to apply LoRA for CNN kernels which will be of (3X3, 5X5, 7X7)?

Any article recommendations will be highly helpful. Thanks

1 Like