Ivan Palomares Carrascosa builds an explanation:
In this article, you will learn why decision trees sometimes fail in practice and how to correct the most common issues with simple, effective techniques.
Topics we will cover include:
- How to spot and reduce overfitting in decision trees.
- How to recognize and fix underfitting by tuning model capacity.
- How noisy or redundant features mislead trees and how feature selection helps.
Read on for some of the perils of CART and some ways to resolve them.