|Title: ||Information Theory|
|Lesson Code: ||321-8602|
|Theory Hours: ||3|
|Lab Hours: |
|Faculty: ||Fotiadis Georgios|
Discrete information sources, alphabets. Entropy. Source coding: Huffman codes, Lempel-Ziv, arithmetic codes. Channel capacity. Second Shannon’s theorem. Binary symmetric channel. Source modeling with Markov chains. Modulation and channel restrictions. Sequences (d, k) and codes RLL. Linear error detection and error correction codes. Codes representation in a binary vectorial space. Hamming distance. Decoding of linear codes. Codes Hamming: design, binary code, extended Hamming codes. Performance bounds of linear codes. ARQ protocols. This course offers an introduction to the theory of information and its applications to communication systems. Emphasis is given on the design, analysis and application of error detection and correction codes.
1. The student will learn the foundations of information theory.
2. The student will be able to compute information that a source produces and examine the possibility to transmit it over a specific channel.
3. The student will be able to choose the most adequate compression algorithms.
4. The student will be able to evaluate the impact of the application of compression algorithms.
5. The student will be able to choose the most adequate error correction algorithms under specific noise conditions and transmission rate.
1. Δ. Βούκαλης, “Θεωρία πληροφοριών – Κώδικες”, ΣΤΕΛΛΑ ΠΑΡΙΚΟΥ & ΣΙΑ,2009 (in Greek).
2. Sam Shanmugan. “Ψηφιακά και Αναλογικά Συστήματα Επικοινωνίας”, Επιστημονικές και Τεχνολογικές Εκδόσεις Α.Γ.ΠΝΕΥΜΑΤΙΚΟΣ, 1979 (in Greek).
1. S.Lin and D. Costello, “Error Control Coding”, Prentice Hall, 2004.
|Learning Activities and Teaching Methods |
|Assessment/Grading Methods |
||125 hours (5 ECTS)
|Language of Instruction|
|Greek, English (for Erasmus students)|
|Μode of delivery |