A cost function, also known as a loss function or objective function, measures how well a machine learning model’s predictions match the actual data.

The most common type of cost function used, especially in regression problems in the Mean Squared Error (MSE). It calculates the average squared difference between the predicted and actual values. Mathematically, it is defined as

Here,