Un-normalizing the prediction with different loss function

I see, so are you using it for regressing the target values?

(btw, thanks for the link)

Also regarding your question, according to this post what you have tried seems to be correct. Did you try to apply the inverse transform to the targets and see whether you get back the initial values or not?