Back to glossary

Loss Function

A mathematical formula that measures the difference between the model's prediction and the actual target value.

Categoryai

Overview

The loss function (or cost function) provides a single number that represents how 'wrong' the model is. The goal of training is to minimize this value.

Common Types

  • Mean Squared Error (MSE): Used for regression tasks.
  • Cross-Entropy Loss: Used for classification tasks.
  • Hinge Loss: Used for Support Vector Machines (SVMs).

Role in Training

Optimizers use the output of the loss function to determine how to adjust the model's weights during backpropagation.

Related Terms

Cross-EntropyMean Squared ErrorStochastic Gradient Descent