I have a member tensor that is created/saved during a backward hook. Hook looks like: def saveGrad(self, grad_input, grad_output): self.currentGrad = grad_output[0].detach() This works fine on one GPU but when running on multiple it tells me 'AttributeError: (module) object has no attribut…

Is it possible to resize a buffer after it has been declared? Yes, you can do .resize_(). Note that the content of the Tensor will be un-initialized though. So you need to make sure that you either zero it or write some value before using it. And additionally is it possible to add a buffer afte…

Initializing a member tensor after creation with DataParallel (repost)

pytorcher September 12, 2020, 2:40pm 14

I think the resize worked! But replacing register_backwards_hook() did not fix my original problem. I’ll post a new thread for that for where I am now. Thanks!