Information theory
Information theory is a branch of applied mathematics and electrical engineering involving the quantification of information. Originally introduced by Claude Shannon in 1948, the theory was primarily designed to find fundamental limits on signal processing operations such as compressing data and reliably storing and communicating data. Since its inception, it has broadened to find applications in many other areas, including statistical inference, natural language processing, cryptography, and even in genetics and neurobiology.
Overview[edit | edit source]
Information theory studies the transmission, processing, extraction, and utilization of information. Abstractly, information can be thought of as the resolution of uncertainty. In the case of communication of information over a noisy channel, this abstract concept was made concrete in 1948 by Claude Shannon in "A Mathematical Theory of Communication", in which 'information' is thought of as a set of possible messages, where the goal is to send these messages over a noisy channel, and then to have the receiver reconstruct the message with low probability of error, in spite of the channel noise.
History[edit | edit source]
Information theory was developed by Claude Shannon during World War II to improve the reliability of data transmission over noisy channels. His seminal 1948 paper, "A Mathematical Theory of Communication", laid the groundwork for virtually all modern digital communications technology, including the Internet and mobile phones.
Applications[edit | edit source]
Information theory has applications in many areas of engineering and science, including telecommunications, computer science, statistics, and genetics. It is used to quantify the amount of information in a signal, to design efficient coding schemes, and to predict the performance of communication systems.
See also[edit | edit source]
- Entropy (information theory)
- Data compression
- Channel capacity
- Coding theory
- Error detection and correction
- Shannon's source coding theorem
- Shannon's channel coding theorem
- Shannon–Hartley theorem
References[edit | edit source]
| Information theory Resources | |
|---|---|
|
 |
Search WikiMD
Ad.Tired of being Overweight? Try W8MD's physician weight loss program.
Semaglutide (Ozempic / Wegovy and Tirzepatide (Mounjaro / Zepbound) available.
Advertise on WikiMD
|
WikiMD's Wellness Encyclopedia |
| Let Food Be Thy Medicine Medicine Thy Food - Hippocrates |
Translate this page: - East Asian
中文,
日本,
한국어,
South Asian
हिन्दी,
தமிழ்,
తెలుగు,
Urdu,
ಕನ್ನಡ,
Southeast Asian
Indonesian,
Vietnamese,
Thai,
မြန်မာဘာသာ,
বাংলা
European
español,
Deutsch,
français,
Greek,
português do Brasil,
polski,
română,
русский,
Nederlands,
norsk,
svenska,
suomi,
Italian
Middle Eastern & African
عربى,
Turkish,
Persian,
Hebrew,
Afrikaans,
isiZulu,
Kiswahili,
Other
Bulgarian,
Hungarian,
Czech,
Swedish,
മലയാളം,
मराठी,
ਪੰਜਾਬੀ,
ગુજરાતી,
Portuguese,
Ukrainian
Medical Disclaimer: WikiMD is not a substitute for professional medical advice. The information on WikiMD is provided as an information resource only, may be incorrect, outdated or misleading, and is not to be used or relied on for any diagnostic or treatment purposes. Please consult your health care provider before making any healthcare decisions or for guidance about a specific medical condition. WikiMD expressly disclaims responsibility, and shall have no liability, for any damages, loss, injury, or liability whatsoever suffered as a result of your reliance on the information contained in this site. By visiting this site you agree to the foregoing terms and conditions, which may from time to time be changed or supplemented by WikiMD. If you do not agree to the foregoing terms and conditions, you should not enter or use this site. See full disclaimer.
Credits:Most images are courtesy of Wikimedia commons, and templates Wikipedia, licensed under CC BY SA or similar.
Contributors: Prab R. Tumpati, MD
