KnowraInformation theoryLinked fromLinked fromThe 64 pages that link to Information theory, each with the reason it gives.All 64Broader topic 1Related 25Narrower topic 32Compared with 6Claude ShannonNarrower topic: Shannon founded this field by defining information quantitatively and deriving limits on communication.Error-correcting codeNarrower topic: Coding theory uses its limits on reliable communication through noisy channels.BitNarrower topic: Information theory treats the bit as a standard unit for measuring information.Digital signal processingNarrower topic: It supplied a broader framework for understanding sampled signals and communication.UncertaintyNarrower topic: Its measures of entropy quantify uncertainty across possible outcomes.Andrey KolmogorovNarrower topic: Kolmogorov’s complexity offered a complementary, object-by-object account of information.Lossless compressionNarrower topic: It provides the framework for measuring how compactly a source can be encoded.Signal modulationNarrower topic: It provides measures for how much information a modulated signal can convey.Hamming distanceNarrower topic: Hamming distance became a practical measure of symbol errors within this broader field.Huffman codingNarrower topic: Huffman coding is a practical source-coding method within this broader theory.Communication channelNarrower topic: It supplies the formal framework for measuring communication over channels.Digital communicationNarrower topic: It provides a broader framework for limits on representing and transmitting information.Digital mediaNarrower topic: Its concepts explain the limits and tradeoffs behind storing and transmitting digital media.Quantum information scienceNarrower topic: It provides concepts such as entropy, channel capacity, and coding for quantum extensions.Coding theoryNarrower topic: Its entropy and channel-capacity results constrain what coding systems can achieve.Shannon–Hartley theoremNarrower topic: The theorem is a central quantitative result within this broader theory.TelecommunicationsNarrower topic: Its capacity limits and coding principles explain what communication channels can achieve.A Mathematical Theory of CommunicationNarrower topic: Shannon’s paper established the field by quantifying information and proving communication limits.Harry NyquistNarrower topic: Nyquist’s transmission limits were precursors to the field Shannon formalized.One-time padNarrower topic: Its formal tools define the secrecy guarantee and the randomness a pad requires.Low-density parity-check codeNarrower topic: LDPC codes arose from the problem of reliable communication at high rates.Ralph HartleyNarrower topic: Hartley’s work supplied an early quantitative foundation for this field.Binary logarithmNarrower topic: Binary logarithms measure information in bits when outcomes are equally likely.Minimum description lengthNarrower topic: MDL draws on information theory’s link between code length and probability.RedundancyNarrower topic: Its measures distinguish useful information from predictable, redundant structure.Hamming codeNarrower topic: Hamming codes address reliable communication under the errors studied by this field.Elwyn BerlekampNarrower topic: Berlekamp’s coding research addresses reliable communication within information theory’s framework.Hamming boundNarrower topic: Coding bounds connect error correction to fundamental limits on reliable communication.Kraft–McMillan inequalityNarrower topic: The inequality is a foundational constraint on lossless code design.Lochs's theoremNarrower topic: The asymptotic constant can be understood through information rates of competing number codings.Noisy-channel coding theoremNarrower topic: The theorem is a central result in this broader field.Wordle (word game)Narrower topic: A guess is valuable partly because it reduces uncertainty about the answer.
KnowraInformation theoryLinked fromLinked fromThe 64 pages that link to Information theory, each with the reason it gives.All 64Broader topic 1Related 25Narrower topic 32Compared with 6Claude ShannonNarrower topic: Shannon founded this field by defining information quantitatively and deriving limits on communication.Error-correcting codeNarrower topic: Coding theory uses its limits on reliable communication through noisy channels.BitNarrower topic: Information theory treats the bit as a standard unit for measuring information.Digital signal processingNarrower topic: It supplied a broader framework for understanding sampled signals and communication.UncertaintyNarrower topic: Its measures of entropy quantify uncertainty across possible outcomes.Andrey KolmogorovNarrower topic: Kolmogorov’s complexity offered a complementary, object-by-object account of information.Lossless compressionNarrower topic: It provides the framework for measuring how compactly a source can be encoded.Signal modulationNarrower topic: It provides measures for how much information a modulated signal can convey.Hamming distanceNarrower topic: Hamming distance became a practical measure of symbol errors within this broader field.Huffman codingNarrower topic: Huffman coding is a practical source-coding method within this broader theory.Communication channelNarrower topic: It supplies the formal framework for measuring communication over channels.Digital communicationNarrower topic: It provides a broader framework for limits on representing and transmitting information.Digital mediaNarrower topic: Its concepts explain the limits and tradeoffs behind storing and transmitting digital media.Quantum information scienceNarrower topic: It provides concepts such as entropy, channel capacity, and coding for quantum extensions.Coding theoryNarrower topic: Its entropy and channel-capacity results constrain what coding systems can achieve.Shannon–Hartley theoremNarrower topic: The theorem is a central quantitative result within this broader theory.TelecommunicationsNarrower topic: Its capacity limits and coding principles explain what communication channels can achieve.A Mathematical Theory of CommunicationNarrower topic: Shannon’s paper established the field by quantifying information and proving communication limits.Harry NyquistNarrower topic: Nyquist’s transmission limits were precursors to the field Shannon formalized.One-time padNarrower topic: Its formal tools define the secrecy guarantee and the randomness a pad requires.Low-density parity-check codeNarrower topic: LDPC codes arose from the problem of reliable communication at high rates.Ralph HartleyNarrower topic: Hartley’s work supplied an early quantitative foundation for this field.Binary logarithmNarrower topic: Binary logarithms measure information in bits when outcomes are equally likely.Minimum description lengthNarrower topic: MDL draws on information theory’s link between code length and probability.RedundancyNarrower topic: Its measures distinguish useful information from predictable, redundant structure.Hamming codeNarrower topic: Hamming codes address reliable communication under the errors studied by this field.Elwyn BerlekampNarrower topic: Berlekamp’s coding research addresses reliable communication within information theory’s framework.Hamming boundNarrower topic: Coding bounds connect error correction to fundamental limits on reliable communication.Kraft–McMillan inequalityNarrower topic: The inequality is a foundational constraint on lossless code design.Lochs's theoremNarrower topic: The asymptotic constant can be understood through information rates of competing number codings.Noisy-channel coding theoremNarrower topic: The theorem is a central result in this broader field.Wordle (word game)Narrower topic: A guess is valuable partly because it reduces uncertainty about the answer.