Are tensors stored in nn.Module.register_buffer trainable?

[ptrblck]

If self.log_alpha is trainable (requires gradients), you should wrap it in an nn.Parameter, which will also make sure to move the tensor to the device.