How can I update the parameters in certain layers?

SKYHOWIE25 · October 21, 2017, 9:31am

Hi

Suppose I have a pretrained model with several convolutional layers and a single fc layer.

How can I update the parameters only in the convolutional layers and leave the parameters in the fc layer untouched.

Thank you.

oneTaken · October 21, 2017, 12:13pm

You can solve this by reading the code doc. This resolves this link:

github.com

pytorch/pytorch/blob/main/torch/optim/optimizer.py

import math
import functools
import warnings
from collections import OrderedDict, defaultdict
from copy import deepcopy
from itertools import chain
from typing import (
    Any,
    Callable,
    DefaultDict,
    Dict,
    Hashable,
    Iterable,
    List,
    Optional,
    Set,
    Tuple,
    TypeVar,
    Union,
    cast,

This file has been truncated. show original

>Arguments:
    params (iterable): an iterable of :class:`Variable` s or
        :class:`dict` s. Specifies what Variables should be optimized.

You just need to list all params you want to update.
This is an exaple for you.

optimizer = torch.optim.Adam( {‘params’: model.conv.parameters()} )