Visualizing loss surface of models

Is there a way to visualize (the approximation of) the loss surface of my model as well as how parameters are updated over it in PyTorch?

Something like they did over here: