Hello, I am working on a new optimization algorithm but I am unable to integrate it in my pytorch code. Is there any way to implement any optimization algorithm other than present in the torch.optim package? Thanks a lot in advance.
Hello, I am working on a new optimization algorithm but I am unable to integrate it in my pytorch code. Is there any way to implement any optimization algorithm other than present in the torch.optim package? Thanks a lot in advance.
Yes, you can just check the implementations of the optimization algorithms of pytorch (e.g. SGD or Adam) and use them as a model to help you get started.
Here is an example of an optimization algorithm that was presented at ICLR: AccSGD
Thanks a lot for your help.