Department of Information & Communication Systems Engineering
 SCHOOL OF ENGINEERING Department of Information & Communication Systems Engineering
 Information & Communication Systems Security Information Systems Artificial Intelligence Computer & Communication Systems Geometry, Dynamical Systems & Cosmology
Information Theory

 Title: Information Theory Lesson Code: 321-8602 Semester: 8 ECTS: 5 Theory Hours: 3 Lab Hours: Faculty:

Content outline

Discrete information sources, alphabets. Entropy. Source coding: Huffman codes, Lempel-Ziv, arithmetic codes. Channel capacity. Second Shannon’s theorem. Binary symmetric channel. Source modeling with Markov chains. Modulation and channel restrictions. Sequences (d, k) and codes RLL. Linear error detection and error correction codes. Codes representation in a binary vectorial space. Hamming distance. Decoding of linear codes. Codes Hamming: design, binary code, extended Hamming codes. Performance bounds of linear codes. ARQ protocols. This course offers an introduction to the theory of information and its applications to communication systems. Emphasis is given on the design, analysis and application of error detection and correction codes.

Learning outcomes

1. The student will learn the foundations of information theory.
2. The student will be able to compute information that a source produces and examine the possibility to transmit it over a specific channel.
3. The student will be able to choose the most adequate compression algorithms.
4. The student will be able to evaluate the impact of the application of compression algorithms.
5. The student will be able to choose the most adequate error correction algorithms under specific noise conditions and transmission rate.

Prerequisites

Not required.

Basic Textbooks

1. Δ. Βούκαλης, “Θεωρία πληροφοριών – Κώδικες”, ΣΤΕΛΛΑ ΠΑΡΙΚΟΥ & ΣΙΑ,2009 (in Greek).
2. Sam Shanmugan. “Ψηφιακά και Αναλογικά Συστήματα Επικοινωνίας”, Επιστημονικές και Τεχνολογικές Εκδόσεις Α.Γ.ΠΝΕΥΜΑΤΙΚΟΣ, 1979 (in Greek).

1. S.Lin and D. Costello, “Error Control Coding”, Prentice Hall, 2004.

Learning Activities and Teaching Methods

Lectures.

Lectures 39 hours

Personal study 83 hours

Final exams 3 hours
Course total 125 hours (5 ECTS)

Language of Instruction
Greek, English (for Erasmus students)

Μode of delivery

Face-to-face.

 Home | Contact University Of The Aegean SCHOOL OF ENGINEERING Department of Information & & Communications Systems Engineering © Copyright ICSD :: 2008 - 2017