BFGS in pytorch

Is there BFGS implement in pytorch?

If L-BFGS is also fine for you, then yes:
https://pytorch.org/docs/stable/optim.html#torch.optim.LBFGS
https://pytorch.org/docs/stable/_modules/torch/optim/lbfgs.html