Best way to make a tensor not part of checkpoint

[ptrblck]

In that case you would have to assign a new nn.Parameter.
Could you explain your use case a bit? Maybe there are some other and better ways.