KnowraShannon entropyLinked fromLinked fromThe 26 pages that link to Shannon entropy, each with the reason it gives.All 26Broader topic 3Related 18Narrower topic 1Compared with 4Kolmogorov complexityCompared with: Entropy is an ensemble average, whereas Kolmogorov complexity describes one individual object.Fisher informationCompared with: Entropy measures outcome uncertainty, while Fisher information measures sensitivity to a parameter.Algorithmic information theoryCompared with: It measures ensemble uncertainty, unlike Kolmogorov complexity's description of individual objects.Heaps's lawCompared with: Entropy summarizes distributional uncertainty, not the count of distinct words as text grows.