Regression Losses-1 (Quick Revision)

Photo by Sigmund on Unsplash
  1. Mean Squared Error (MSE)
  2. Mean Absolute Error (MAE)
  3. Huber Loss
  4. Adaptive Loss

Mean Squared Error

Mean Squared Error Equation

Advantages

  • Simple Equation, Can optimize easily compared to other equations.
  • Has proven its ability over the years, this is majorly used in fields like signal processing

Disadvantages

  • It is highly affected by Outliers. So if the data contains outliers, better not to use it.

Mean Absolute Error

Mean Absolute Error Equation

Advantages

  • It is not much affected by outliers. So if the data contains outliers, better to use MAE as the loss.

Disadvantages

  • The Optimization is little bit complex compared to MSE

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Navaneeth Sharma

Navaneeth Sharma

ML Engineer | AI Enthusiast | Love to Write | Published couple of ML integrated pip packages | Part time Researcher