D
Demerzel
Video
Measures of information, entropy
Builds entropy from surprise: low-probability events are more surprising, surprise as log(1/p), and entropy as expected surprise — the information-theoretic quantity behind cross entropy and mutual i…