train loss gets extraordinary higher sometimes

some times loss gets very high.
Is there any chances that train stops and outputs best model at the moment loss is very high?
If so, it would be neccesary to check both Final Accuracy and Loss at that time right?