Non differentiable loss function in CNN

[netaglazer (neta)]

i think this is actually the confusing point.

can you explain a little bit more?