Writing a loss function is no different from writing a neural network, or an autograd function.
Here’s an example of writing a mean-square-error loss function:
def mse_loss(input, target):
return ((input - target) ** 2).sum() / input.data.nelement()