How is the “loss has not improved” quantified? Is there any threshold e.g. if the loss has not changed by +/- epsilon, the learning rate will be reduced?
Yes, the threshold is used to determine, if a significant change in the metric was registered.
Have a look at the docs and the arguments for this method.