Entropy and Information Gain
Measure uncertainty in bits, then measure how much a question removes - the quantity a decision tree greedily maximises at every split.
FoundationsModule 530 min · 120 XP
This is a premium lesson
Sign in and enrol to read the full lesson, run the code, take the quiz, and earn XP toward the path badge.