1. My network stopped learning. It got stuck in some high loss value! I think I may have hit a local minimum, but I'm not sure. What can I do to shed light upon this question?

    2. A.:

    Plot the gradient norm to see if it's zero or very close to zero.