Department of Information & Communication Systems Engineering
 SCHOOL OF ENGINEERING Department of Information & Communication Systems Engineering
 Information & Communication Systems Security Information Systems Artificial Intelligence Computer & Communication Systems Geometry, Dynamical Systems & Cosmology
Θεωρία Πληροφορίας

 Title: Θεωρία Πληροφορίας Lesson Code: 321-8602 Semester: 8 ECTS: 5 Theory Hours: 3 Lab Hours: Faculty: Rizomiliotis Panagiotis

Content outline
Discrete information sources, alphabets. Entropy. Source coding: Huffman codes, Lempel-Ziv, arithmetic codes. Channel capacity. Second Shannon’s theorem. Binary symmetric channel. Source modeling with Markov chains. Modulation and channel restrictions. Sequences (d, k) and codes RLL. Linear error detection and error correction codes. Codes representation in a binary vectorial space. Hamming distance. Decoding of linear codes. Codes Hamming: design, binary code, extended Hamming codes. Performance bounds of linear codes. ARQ protocols. This course offers an introduction to the theory of information and its applications to communication systems. Emphasis is given on the design, analysis and application of error detection and correction codes.

Learning outcomes
1. The student will learn the foundations of information theory.
2. The student will be able to compute information that a source produces and examine the possibility to transmit it over a specific channel.
3. The student will be able to choose the most adequate compression algorithms.
4. The student will be able to evaluate the impact of the application of compression algorithms.
5. The student will be able to choose the most adequate error correction algorithms under specific noise conditions and transmission rate.

Prerequisites
Linear algebra, probability theory.

Basic Textbooks
1. Δ. Βούκαλης, “Θεωρία πληροφοριών – Κώδικες”, ΣΤΕΛΛΑ ΠΑΡΙΚΟΥ & ΣΙΑ,2009 (in Greek).
2. Sam Shanmugan. “Ψηφιακά και Αναλογικά Συστήματα Επικοινωνίας”, Επιστημονικές και Τεχνολογικές Εκδόσεις Α.Γ.ΠΝΕΥΜΑΤΙΚΟΣ, 1979 (in Greek).

1. S.Lin and D. Costello, “Error Control Coding”, Prentice Hall, 2004.

Learning Activities and Teaching Methods
Lectures.