This is a list of information theory topics, by Wikipedia page.
- A Mathematical Theory of Communication
- algorithmic information theory
- arithmetic encoding
- channel capacity
- Communication Theory of Secrecy Systems
- conditional entropy
- conditional quantum entropy
- confusion and diffusion
- cross entropy
- data compression
- entropy encoding
- Fisher information
- Hick's law
- Hirchman uncertainty
- Huffman encoding
- information bottleneck method
- information entropy
- information theoretic security
- information theory
- joint entropy
- Kullback-Leibler divergence
- lossless data compression
- negentropy
- principle of maximum entropy
- quantum information science
- range encoding
- redundancy
- Rényi entropy
- self-information
- Shannon limit
- Shannon's law
- Shannon's theorem
Famous quotes containing the words index, information, theory and/or articles:
“Exile as a mode of genius no longer exists; in place of Joyce we have the fragments of work appearing in Index on Censorship.”
—Nadine Gordimer (b. 1923)
“In the information age, you don’t teach philosophy as they did after feudalism. You perform it. If Aristotle were alive today he’d have a talk show.”
—Timothy Leary (b. 1920)
“The struggle for existence holds as much in the intellectual as in the physical world. A theory is a species of thinking, and its right to exist is coextensive with its power of resisting extinction by its rivals.”
—Thomas Henry Huxley (1825–95)
“There are several natural phenomena which I shall have to have explained to me before I can keep on going as a resident member of the human race. One is the metamorphosis which hats and suits undergo exactly one week after their purchase, whereby they are changed from smart, intensely becoming articles of apparel into something children use when they want to “dress up like daddy.””
—Robert Benchley (1889–1945)