Availability: Entropy and Information Theory | Technische Universität München

Entropy and Information Theory:

Saved in:

Bibliographic Details
Main Author:	Gray, Robert M. 1943- (Author)
Format:	Book
Language:	English
Published:	New york [u.a.] Springer 2011
Edition:	2. ed.
Subjects:	Informationstheorie Entropie Codierungstheorie Information Entropie > Informationstheorie
Links:	http://deposit.dnb.de/cgi-bin/dokserv?id=3540827&prov=M&dok_var=1&dok_ext=htm http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=020874959&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA
Physical Description:	XXVII, 409 S. 235 mm x 155 mm
ISBN:	1441979697 9781441979698

Staff View

MARC


LEADER	00000nam a2200000 c 4500
001	BV036960060
003	DE-604
005	20110303
007	t\|
008	110117s2011 xx \|\|\|\| 00\|\|\| eng d
015			\|a 10,N39 \|2 dnb
016	7		\|a 1007151617 \|2 DE-101
020			\|a 1441979697 \|c Gb. : ca. EUR 71.64 (DE) (freier Pr.), ca. sfr 96.00 (freier Pr.) \|9 1-441-97969-7
020			\|a 9781441979698 \|c Gb. : ca. EUR 71.64 (DE) (freier Pr.), ca. sfr 96.00 (freier Pr.) \|9 978-1-4419-7969-8
024	3		\|a 9781441979698
028	5	2	\|a Best.-Nr.: 12557974
035			\|a (OCoLC)706971421
035			\|a (DE-599)DNB1007151617
040			\|a DE-604 \|b ger \|e rakddb
041	0		\|a eng
049			\|a DE-473 \|a DE-739
084			\|a SK 880 \|0 (DE-625)143266: \|2 rvk
084			\|a 620 \|2 sdnb
100	1		\|a Gray, Robert M. \|d 1943- \|e Verfasser \|0 (DE-588)134262336 \|4 aut
245	1	0	\|a Entropy and Information Theory \|c Robert M. Gray
250			\|a 2. ed.
264		1	\|a New york [u.a.] \|b Springer \|c 2011
300			\|a XXVII, 409 S. \|c 235 mm x 155 mm
336			\|b txt \|2 rdacontent
337			\|b n \|2 rdamedia
338			\|b nc \|2 rdacarrier
650	0	7	\|a Informationstheorie \|0 (DE-588)4026927-9 \|2 gnd \|9 rswk-swf
650	0	7	\|a Entropie \|0 (DE-588)4014894-4 \|2 gnd \|9 rswk-swf
650	0	7	\|a Codierungstheorie \|0 (DE-588)4139405-7 \|2 gnd \|9 rswk-swf
650	0	7	\|a Information \|0 (DE-588)4026899-8 \|2 gnd \|9 rswk-swf
650	0	7	\|a Entropie \|g Informationstheorie \|0 (DE-588)4743861-7 \|2 gnd \|9 rswk-swf
689	0	0	\|a Entropie \|g Informationstheorie \|0 (DE-588)4743861-7 \|D s
689	0	1	\|a Codierungstheorie \|0 (DE-588)4139405-7 \|D s
689	0		\|5 DE-604
689	1	0	\|a Codierungstheorie \|0 (DE-588)4139405-7 \|D s
689	1	1	\|a Informationstheorie \|0 (DE-588)4026927-9 \|D s
689	1	2	\|a Entropie \|0 (DE-588)4014894-4 \|D s
689	1		\|8 1\p \|5 DE-604
689	2	0	\|a Entropie \|0 (DE-588)4014894-4 \|D s
689	2	1	\|a Information \|0 (DE-588)4026899-8 \|D s
689	2		\|8 2\p \|5 DE-604
776	0	8	\|i Erscheint auch als \|n Online-Ausgabe \|z 978-1-4419-7970-4
856	4	2	\|m X:MVB \|q text/html \|u http://deposit.dnb.de/cgi-bin/dokserv?id=3540827&prov=M&dok_var=1&dok_ext=htm \|3 Inhaltstext
856	4	2	\|m Digitalisierung UB Passau - ADAM Catalogue Enrichment \|q application/pdf \|u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=020874959&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA \|3 Inhaltsverzeichnis
883	1		\|8 1\p \|a cgwrk \|d 20201028 \|q DE-101 \|u https://d-nb.info/provenance/plan#cgwrk
883	1		\|8 2\p \|a cgwrk \|d 20201028 \|q DE-101 \|u https://d-nb.info/provenance/plan#cgwrk
943	1		\|a oai:aleph.bib-bvb.de:BVB01-020874959

Record in the Search Index

_version_	1819253407362318336
adam_text	Contents Preface................................................................................................... vii Introduction............................................................................................ xvii 1 Information Sources..................................................................... 1.1 Probability Spaces and Random Variables........................... 1.2 Random Processes and Dynamical Systems.......................... 1.3 Distributions.......................................................................... 1.4 Standard Alphabets................................................................ 1.5 Expectation............................................................................. 1.6 Asymptotic Mean Stationarity............................................... 1.7 Ergodic Properties.................................................................. 1 1 5 7 12 13 16 17 2 Pair Processes: Channels, Codes, and Couplings...................... 2.1 Pair Processes........................................................................ 2.2 Channels................................................................................. 2.3 Stationarity Properties of Channels ..................................... 2.4 Extremes: Noiseless and Completely Random Channels.... 2.5 Deterministic Channels and Sequence Coders.................... 2.6 Stationary and Sliding-Block Codes....................................... 2.7 Block Codes ............................................................................ 2.8 Random Punctuation Sequences .......................................... 2.9 Memoryless Channels............................................................. 2.10 Finite-Memory Channels........................................................ 2.11 Output Mixing Channels........................................................ 2.12 Block Independent Channels................................................. 2.13 Conditionally Block Independent Channels......................... 2.14 Stationarizing Block Independent Channels........................ 2.15 Primitive Channels.................................................................. 2.16 Additive Noise Channels........................................................ 2.17 Markov Channels................................................................... 21 21 22 25 29 30 31 37 38 42 42 43 45 46 46 48 49 49 xiii xiv Contents 2.18 Finite-State Channels and Codes.......................................... 2.19 Cascade Channels.................................................................. 2.20 Conununication Systems....................................................... 2.21 Couplings............................................................................... 2.22 Block to Sliding-Block: The Rohlin-Kakutani Theorem......... 3 Entropy.................................................................................................... 61 Entropy and Entropy Rate...................................................... Divergence Inequality and Relative Entropy...................... Basic Properties of Entropy................................................... Entropy Rate ......................................................................... Relative Entropy Rate........................................................... Conditional Entropy and Mutual Information...................... Entropy Rate Revisited................................................ ,........ Markov Approximations.............................................. Relative Entropy Densities.................................................... 61 65 69 78 81 82 90 91 93 The Entropy Ergodic Theorem......................................................... 97 97 100 106 110 114 3.1 3.2 3.3 3.4 3.5 3.6 3.7 3.8 3.9 4 4.1 4.2 4.3 4.4 4.5 5 50 51 52 52 53 History................................................................................... Stationary Ergodic Sources.................................................... Stationary Nonergodic Sources............................................. AMS Sources........................................................................... The Asymptotic Equipartition Property................................ Distortion and Approximation.......................................................... 117 5.1 Distortion Measures.............................................................. 117 5.2 Fidelity Criteria...................................................................... 120 5.3 Average Limiting Distortion.................................................. 121 5.4 Communications Systems Performance.............................. 123 5.5 Optimal Performance............................................................ 124 5.6 Code Approximation.............................................................. 124 5.7 Approximating Random Vectors and Processes ................ 129 5.8 The Monge/Kantorovich/Vasershtein Distance.................. 132 5.9 Variation and Distribution Distance.................................... 132 5.10 Coupling Discrete Spaces with the Hamming Distance....... 134 5.11 Process Distance and Approximation.................................... 135 5.12 Source Approximation and Codes......................................... 141 5.13 d-bar Continuous Channels.................................................. 142 6 Distortion and Entropy....................................................................... 147 6.1 6.2 6.3 6.4 6.5 6.6 The Fano Inequality................................................................ Code Approximation and Entropy Rate............................... Pinsker’s and Marton’s Inequalities...................................... Entropy and Isomorphism................................................... Almost Lossless Source Coding........................................... Asymptotically Optimal Almost Lossless Codes................ 147 150 152 156 160 168 Contents XV 6.7 Modeling and Simulation ...................................................... 169 7 Relative Entropy........................................................................... 173 7.1 Divergence.............................................................................. 173 7.2 Conditional Relative Entropy................................................. 189 7.3 Limiting Entropy Densities...................................................... 202 7.4 Information for General Alphabets....................................... 204 7.5 Convergence Results.............................................................. 216 8 Information Rates........................................................................... 219 8.1 Information Rates for Finite Alphabets.................................. 219 8.2 Information Rates for General Alphabets............................... 221 8.3 A Mean Ergodic Theorem for Densities.................................. 225 8.4 Information Rates of Stationary Processes............................. 227 8.5 The Data Processing Theorem................................................. 234 8.6 Memoryless Channels and Sources......................................... 235 9 Distortion and Information.......................................................... 237 9.1 The Shannon Distortion-Rate Function.................................. 237 9.2 Basic Properties ....................................................................... 239 9.3 Process Definitions of the Distortion-Rate Function............ 242 9.4 The Distortion-Rate Function as a Lower Bound................... 250 9.5 Evaluating the Rate-Distortion Function................................ 252 10 Relative Entropy Rates.................................................................. 265 10.1 Relative Entropy Densities and Rates..................................... 265 10.2 Markov Dominating Measures................................................. 268 10.3 Stationary Processes................................................................ 272 10.4 Mean Ergodic Theorems.......................................................... 275 11 Ergodic Theorems for Densities ................................................. 281 11.1 Stationary Ergodic Sources...................................................... 281 11.2 Stationary Nonergodic Sources................................................286 11.3 AMS Sources.............................................................................. 290 11.4 Ergodic Theorems for Information Densities.......................... 293 12 Source Coding Theorems............................................................. 295 12.1 Source Coding and Channel Coding....................................... 295 12.2 Block Source Codes for AMS Sources..................................... 296 12.3 Block Source Code Mismatch................................................... 307 12.4 Block Coding Stationary Sources............................................ 310 12.5 Block Coding AMS Ergodic Sources......................................... 312 12.6 Subadditive Fidelity Criteria................................................... 319 12.7 Asynchronous Block Codes.....................................................321 12.8 Sliding-Block Source Codes .....................................................323 12.9 A Geometric Interpretation.................................................... 333 xvi Contents 13 Properties of Good SourceCodes................................................ 335 13.1 Optimal and Asymptotically Optimal Codes.......................... 335 13.2 Block Codes............................................................................ 337 13.3 Sliding-Block Codes................................................................ 343 14 Coding for Noisy Channels ......................................................... 14.1 Noisy Channels...................................................................... 14.2 Feinstein s Lemma................................................................. 14.3 Feinstein’s Theorem.............................................................. 14.4 Channel Capacity................................................................... 14.5 Robust Block Codes................................................................ 14.6 Block Coding Theorems for Noisy Channels........................ 14.7 Joint Source and Channel Block Codes................................ 14.8 Synchronizing Block Channel Codes ................................... 14.9 Sliding-block Source and Channel Coding........................... 359 359 361 364 367 372 375 377 380 384 References............................................................................................ 395 Index........................................................................................................ 405
any_adam_object	1
author	Gray, Robert M. 1943-
author_GND	(DE-588)134262336
author_facet	Gray, Robert M. 1943-
author_role	aut
author_sort	Gray, Robert M. 1943-
author_variant	r m g rm rmg
building	Verbundindex
bvnumber	BV036960060
classification_rvk	SK 880
ctrlnum	(OCoLC)706971421 (DE-599)DNB1007151617
discipline	Maschinenbau / Maschinenwesen Mathematik
edition	2. ed.
format	Book
fullrecord	<?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>02595nam a2200589 c 4500</leader><controlfield tag="001">BV036960060</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20110303 </controlfield><controlfield tag="007">t\|</controlfield><controlfield tag="008">110117s2011 xx \|\|\|\| 00\|\|\| eng d</controlfield><datafield tag="015" ind1=" " ind2=" "><subfield code="a">10,N39</subfield><subfield code="2">dnb</subfield></datafield><datafield tag="016" ind1="7" ind2=" "><subfield code="a">1007151617</subfield><subfield code="2">DE-101</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">1441979697</subfield><subfield code="c">Gb. : ca. EUR 71.64 (DE) (freier Pr.), ca. sfr 96.00 (freier Pr.)</subfield><subfield code="9">1-441-97969-7</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9781441979698</subfield><subfield code="c">Gb. : ca. EUR 71.64 (DE) (freier Pr.), ca. sfr 96.00 (freier Pr.)</subfield><subfield code="9">978-1-4419-7969-8</subfield></datafield><datafield tag="024" ind1="3" ind2=" "><subfield code="a">9781441979698</subfield></datafield><datafield tag="028" ind1="5" ind2="2"><subfield code="a">Best.-Nr.: 12557974</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)706971421</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)DNB1007151617</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakddb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-473</subfield><subfield code="a">DE-739</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">SK 880</subfield><subfield code="0">(DE-625)143266:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">620</subfield><subfield code="2">sdnb</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Gray, Robert M.</subfield><subfield code="d">1943-</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)134262336</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Entropy and Information Theory</subfield><subfield code="c">Robert M. Gray</subfield></datafield><datafield tag="250" ind1=" " ind2=" "><subfield code="a">2. ed.</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">New york [u.a.]</subfield><subfield code="b">Springer</subfield><subfield code="c">2011</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">XXVII, 409 S.</subfield><subfield code="c">235 mm x 155 mm</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Informationstheorie</subfield><subfield code="0">(DE-588)4026927-9</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Entropie</subfield><subfield code="0">(DE-588)4014894-4</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Codierungstheorie</subfield><subfield code="0">(DE-588)4139405-7</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Information</subfield><subfield code="0">(DE-588)4026899-8</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Entropie</subfield><subfield code="g">Informationstheorie</subfield><subfield code="0">(DE-588)4743861-7</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Entropie</subfield><subfield code="g">Informationstheorie</subfield><subfield code="0">(DE-588)4743861-7</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="1"><subfield code="a">Codierungstheorie</subfield><subfield code="0">(DE-588)4139405-7</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="689" ind1="1" ind2="0"><subfield code="a">Codierungstheorie</subfield><subfield code="0">(DE-588)4139405-7</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="1" ind2="1"><subfield code="a">Informationstheorie</subfield><subfield code="0">(DE-588)4026927-9</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="1" ind2="2"><subfield code="a">Entropie</subfield><subfield code="0">(DE-588)4014894-4</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="1" ind2=" "><subfield code="8">1\p</subfield><subfield code="5">DE-604</subfield></datafield><datafield tag="689" ind1="2" ind2="0"><subfield code="a">Entropie</subfield><subfield code="0">(DE-588)4014894-4</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="2" ind2="1"><subfield code="a">Information</subfield><subfield code="0">(DE-588)4026899-8</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="2" ind2=" "><subfield code="8">2\p</subfield><subfield code="5">DE-604</subfield></datafield><datafield tag="776" ind1="0" ind2="8"><subfield code="i">Erscheint auch als</subfield><subfield code="n">Online-Ausgabe</subfield><subfield code="z">978-1-4419-7970-4</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">X:MVB</subfield><subfield code="q">text/html</subfield><subfield code="u">http://deposit.dnb.de/cgi-bin/dokserv?id=3540827&prov=M&dok_var=1&dok_ext=htm</subfield><subfield code="3">Inhaltstext</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">Digitalisierung UB Passau - ADAM Catalogue Enrichment</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=020874959&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="883" ind1="1" ind2=" "><subfield code="8">1\p</subfield><subfield code="a">cgwrk</subfield><subfield code="d">20201028</subfield><subfield code="q">DE-101</subfield><subfield code="u">https://d-nb.info/provenance/plan#cgwrk</subfield></datafield><datafield tag="883" ind1="1" ind2=" "><subfield code="8">2\p</subfield><subfield code="a">cgwrk</subfield><subfield code="d">20201028</subfield><subfield code="q">DE-101</subfield><subfield code="u">https://d-nb.info/provenance/plan#cgwrk</subfield></datafield><datafield tag="943" ind1="1" ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-020874959</subfield></datafield></record></collection>
id	DE-604.BV036960060
illustrated	Not Illustrated
indexdate	2024-12-20T14:45:26Z
institution	BVB
isbn	1441979697 9781441979698
language	English
oai_aleph_id	oai:aleph.bib-bvb.de:BVB01-020874959
oclc_num	706971421
open_access_boolean
owner	DE-473 DE-BY-UBG DE-739
owner_facet	DE-473 DE-BY-UBG DE-739
physical	XXVII, 409 S. 235 mm x 155 mm
publishDate	2011
publishDateSearch	2011
publishDateSort	2011
publisher	Springer
record_format	marc
spellingShingle	Gray, Robert M. 1943- Entropy and Information Theory Informationstheorie (DE-588)4026927-9 gnd Entropie (DE-588)4014894-4 gnd Codierungstheorie (DE-588)4139405-7 gnd Information (DE-588)4026899-8 gnd Entropie Informationstheorie (DE-588)4743861-7 gnd
subject_GND	(DE-588)4026927-9 (DE-588)4014894-4 (DE-588)4139405-7 (DE-588)4026899-8 (DE-588)4743861-7
title	Entropy and Information Theory
title_auth	Entropy and Information Theory
title_exact_search	Entropy and Information Theory
title_full	Entropy and Information Theory Robert M. Gray
title_fullStr	Entropy and Information Theory Robert M. Gray
title_full_unstemmed	Entropy and Information Theory Robert M. Gray
title_short	Entropy and Information Theory
title_sort	entropy and information theory
topic	Informationstheorie (DE-588)4026927-9 gnd Entropie (DE-588)4014894-4 gnd Codierungstheorie (DE-588)4139405-7 gnd Information (DE-588)4026899-8 gnd Entropie Informationstheorie (DE-588)4743861-7 gnd
topic_facet	Informationstheorie Entropie Codierungstheorie Information Entropie Informationstheorie
url	http://deposit.dnb.de/cgi-bin/dokserv?id=3540827&prov=M&dok_var=1&dok_ext=htm http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=020874959&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA
work_keys_str_mv	AT grayrobertm entropyandinformationtheory

Availability

‌

Order via interlibrary loan Table of Contents