This is a list of information theory topics, by Wikipedia page.
- A Mathematical Theory of Communication
- algorithmic information theory
- arithmetic encoding
- channel capacity
- Communication Theory of Secrecy Systems
- conditional entropy
- conditional quantum entropy
- confusion and diffusion
- cross entropy
- data compression
- entropy encoding
- Fisher information
- Hick's law
- Hirchman uncertainty
- Huffman encoding
- information bottleneck method
- information entropy
- information theoretic security
- information theory
- joint entropy
- Kullback-Leibler divergence
- lossless data compression
- negentropy
- principle of maximum entropy
- quantum information science
- range encoding
- redundancy
- Rényi entropy
- self-information
- Shannon limit
- Shannon's law
- Shannon's theorem
Famous quotes containing the words index, information, theory and/or articles:
“Exile as a mode of genius no longer exists; in place of Joyce we have the fragments of work appearing in Index on Censorship.”
—Nadine Gordimer (b. 1923)
“The information links are like nerves that pervade and help to animate the human organism. The sensors and monitors are analogous to the human senses that put us in touch with the world. Data bases correspond to memory; the information processors perform the function of human reasoning and comprehension. Once the postmodern infrastructure is reasonably integrated, it will greatly exceed human intelligence in reach, acuity, capacity, and precision.”
—Albert Borgman, U.S. educator, author. Crossing the Postmodern Divide, ch. 4, University of Chicago Press (1992)
“The things that will destroy America are prosperity-at-any- price, peace-at-any-price, safety-first instead of duty-first, the love of soft living, and the get-rich-quick theory of life.”
—Theodore Roosevelt (1858–1919)
“It was not sufficient for the disquiet of our minds that we disputed at the end of seventeen hundred years upon the articles of our own religion, but we must likewise introduce into our quarrels those of the Chinese. This dispute, however, was not productive of any great disturbances, but it served more than any other to characterize that busy, contentious, and jarring spirit which prevails in our climates.”
—Voltaire [François Marie Arouet] (1694–1778)