|proj(x-g)-x| parameter

Hi,

What characterizes value |proj(x-g)-x| in each iteration?

Hi Alexey,
Sorry for the late answer,
I believe it is the norm of the update to the model. It checks if the model changes significantly enough.
x: your model
g: the gradient or \delta m
proj: projection (if you use lower and upper bounds)

1 Like