Hello, I hope you are having a great time. Could you please help me about the following problem?

Because the range of the target values is completely different and oscillates between 0 to 6000, the target should be normalized to train the model.
For example :

@FA_mn not really an answer to your question but out of curiosity how this loss function works? I mean what is its difference from MSE and why do you use the derivatives (apologies if it is a newbie question but I am quite new to it).

I see, so are you using it for regressing the target values?

(btw, thanks for the link)

Also regarding your question, according to this post what you have tried seems to be correct. Did you try to apply the inverse transform to the targets and see whether you get back the initial values or not?

In PDEs, I do not have the target values explicitly. If in regression, x_i is input, and u_i is its related target, I can use

loss = sum((u_i - y_i)^2, i=1,..,N),

where y_i is the output of the network related to x_i.
However, in PDEs, I do not have u_i explicitly, and only I know other information, such as the values of the First- or Second-order partial differential equation. Therefore, I cannot use loss = sum((u_i-y_i)^2, i=1,..,N).

I tried to apply the inverse transform in my PDEs, and I think it worked correctly. I should examine the suggestion mentioned in the link you introduced.
Thanks a lot.