It looks like pytorch initializes weights of models by default with FloatTensors. However, I would like to have DoubleTensors. I initialize my weights with
def weight_init(self): for module in self.modules(): if (isinstance(module, nn.Conv3d) or isinstance(module, nn.Linear)): init.orthogonal_(module.weight)
What is a proper way to initialize a model’s weights with DoubleTensors? Or is this generally not recommended?
Thanks for any help.