Custom loss functions

You can pass the parameter in a list to it:

param = nn.Parameter(torch.randn(1))
model = MyModel()
optimizer = torch.optim.SGD(list(model.parameters()) + [param], lr=1e-3)
1 Like