This video is the second of three lectures in this unit. The first and third lectures of this unit are missing due to technical reasons.
Instructors: Prof. Paul Penfield, Prof. Seth Lloyd
Resources
Technical
Hamming, Richard W. Coding and Information Theory. 2nd ed. Englewood Cliffs, NJ: Prentice-Hall, 1986. ISBN: 9780131390720.
Examples of error detection without correction:
- CRC (Cyclic Redundancy Check) - Ritter, Terry. "The Great CRC Mystery." Dr. Dobb's Journal 11 (February 1986): 26-34.
- ISBN (International Standard Book Number) - U.S. ISBN Home, Manual, and programming tools
- ISSN (International Standard Serial Number) - ISSN Home; should blogs get ISSNs? See Clark, Joe. Compatibility of Weblogs and ISSN. September 22, 2003.
- LUHN mod 10, used for credit cards - Stiles, Harrell. Credit Card Validation - Check Digits. February 25, 1997.
- Error Correcting Codes links from Robert Morelos-Zaragoza and tutorial (archived) from University of Edinburgh Computer Science
Hanley, Stan. Reed-Solomon Codes and CD Encoding. April 24, 2002; another Reed-Solomon tutorial (archived)
Quantum Decoherence and Error Correction
Historical
Richard W. Hamming (1915-1998)
Pinch, Richard. "Coding theory: the first 50 years." PASS Maths 1 (September 1997).
Cipra, Barry A. "The Ubiquitous Reed-Solomon Codes." SIAM News 26 (January 1993).
Books
There are many excellent texts on coding theory and communications, most of which assume a familiarity with mathematics beyond introductory calculus.
Truxal, John G. The Age of Electronic Messages. Cambridge, MA: MIT Press, 1990. ISBN: 9780262701020.
Aimed at providing technology and engineering exposure to liberal arts students. Nonmathematical, with lots of great examples. Based on material taught at the State University of New York at Stony Brook.
Pierce, John R. An Introduction to Information Theory: Symbols, Signals, and Noise. 2nd ed. New York, NY: Dover Publications, Inc., 1980. ISBN: 9780486240619.
Mostly nonmathematical, by one of the nation's great scientific contributors at AT&T Bell Laboratories, who was also interested in reaching a general audience. He was later on the faculty at Caltech. One of his interesting sideline activities was writing science fiction stories under the pen name J. J. Coupling. He died April 2, 2002 at the age of 92.
Gallager, Robert G. Information Theory and Reliable Communications. New York, NY: John Wiley & Sons, Inc., 1968. ISBN: 9780471290483.
One of the early textbooks, designed for first-year graduate students, by one of the pioneers in communications, an MIT faculty member. He was later awarded the IEEE Medal of Honor, its most prestigious award.
Cover, Thomas M., and Joy A. Thomas. Elements of Information Theory. New York, NY: John Wiley & Sons, Inc., 2006. ISBN: 9780471241959.
Aimed at university seniors and first-year graduate students. One of several excellent books of that era. Professor Cover, at Stanford University, is one of the world leaders in Information Theory.