Decision trees – the unreasonable power of nested decision rules

Decision trees use entropy-based information gain to recursively split data into pure regions, balancing interpretability and speed against the stair-stepping problem for linear boundaries.