New Foundations for Information Theory

New Foundations for Information Theory
Author :
Publisher : Springer Nature
Total Pages : 121
Release :
ISBN-10 : 9783030865528
ISBN-13 : 3030865525
Rating : 4/5 (525 Downloads)

Book Synopsis New Foundations for Information Theory by : David Ellerman

Download or read book New Foundations for Information Theory written by David Ellerman and published by Springer Nature. This book was released on 2021-10-30 with total page 121 pages. Available in PDF, EPUB and Kindle. Book excerpt: This monograph offers a new foundation for information theory that is based on the notion of information-as-distinctions, being directly measured by logical entropy, and on the re-quantification as Shannon entropy, which is the fundamental concept for the theory of coding and communications. Information is based on distinctions, differences, distinguishability, and diversity. Information sets are defined that express the distinctions made by a partition, e.g., the inverse-image of a random variable so they represent the pre-probability notion of information. Then logical entropy is a probability measure on the information sets, the probability that on two independent trials, a distinction or “dit” of the partition will be obtained. The formula for logical entropy is a new derivation of an old formula that goes back to the early twentieth century and has been re-derived many times in different contexts. As a probability measure, all the compound notions of joint, conditional, and mutual logical entropy are immediate. The Shannon entropy (which is not defined as a measure in the sense of measure theory) and its compound notions are then derived from a non-linear dit-to-bit transform that re-quantifies the distinctions of a random variable in terms of bits—so the Shannon entropy is the average number of binary distinctions or bits necessary to make all the distinctions of the random variable. And, using a linearization method, all the set concepts in this logical information theory naturally extend to vector spaces in general—and to Hilbert spaces in particular—for quantum logical information theory which provides the natural measure of the distinctions made in quantum measurement. Relatively short but dense in content, this work can be a reference to researchers and graduate students doing investigations in information theory, maximum entropy methods in physics, engineering, and statistics, and to all those with a special interest in a new approach to quantum information theory.


New Foundations for Information Theory Related Books

New Foundations for Information Theory
Language: en
Pages: 121
Authors: David Ellerman
Categories: Philosophy
Type: BOOK - Published: 2021-10-30 - Publisher: Springer Nature

GET EBOOK

This monograph offers a new foundation for information theory that is based on the notion of information-as-distinctions, being directly measured by logical ent
Mathematical Foundations of Information Theory
Language: en
Pages: 130
Authors: Aleksandr I?Akovlevich Khinchin
Categories: Mathematics
Type: BOOK - Published: 1957-01-01 - Publisher: Courier Corporation

GET EBOOK

First comprehensive introduction to information theory explores the work of Shannon, McMillan, Feinstein, and Khinchin. Topics include the entropy concept in pr
New Foundations for Physical Geometry
Language: en
Pages: 374
Authors: Tim Maudlin
Categories: Mathematics
Type: BOOK - Published: 2014-02 - Publisher:

GET EBOOK

Tim Maudlin sets out a completely new method for describing the geometrical structure of spaces, and thus a better mathematical tool for describing and understa
Uncertainty and Information
Language: en
Pages: 499
Authors: George J. Klir
Categories: Technology & Engineering
Type: BOOK - Published: 2005-11-22 - Publisher: John Wiley & Sons

GET EBOOK

Deal with information and uncertainty properly and efficientlyusing tools emerging from generalized information theory Uncertainty and Information: Foundations
Mathematical Foundations of Information Theory
Language: en
Pages: 130
Authors: A. Ya. Khinchin
Categories: Mathematics
Type: BOOK - Published: 2013-04-09 - Publisher: Courier Corporation

GET EBOOK

First comprehensive introduction to information theory explores the work of Shannon, McMillan, Feinstein, and Khinchin. Topics include the entropy concept in pr