What is cost function loss function

A scalar functions which quantifies the error factor of the Neural Network.

Lower the cost function better the Neural network.

A function that quantifies the difference between the predicted values of a model and the actual target values.