Torch.cat two variables, one's requires_grad= True, another's requires_grad = False

autograd
1

If I use torch.cat to stack two variables, one’s requires_grad =True, another’s requires_grad=False, will these properties retain during .backward() and .step()

2

It seems the answer is YES after I experimented a little.

3

Yes, in general, if any input requires grad, so will the output.

1 Like
4

Hi, did you also use default_collate function of torch in dataloader on stacked tensors with different requires_grad values? I am hitting a problem with creating batch on this kind of data?