Title Information Theory
Lesson Code 321-8600
Semester 7
ECTS 5
Hours (Theory) 3
Hours (Lab) 0
Faculty Maliatsos Konstantinos

Syllabus

Discrete information sources, alphabets. Entropy. Source coding: Huffman codes, Lempel-Ziv, arithmetic codes. Channel capacity. Second Shannon’s theorem. Binary symmetric channel. Source modeling with Markov chains. Modulation and channel restrictions. Sequences (d, k) and codes RLL. Linear error detection and error correction codes. Codes representation in a binary vectorial space. Hamming distance. Decoding of linear codes. Codes Hamming: design, binary code, extended Hamming codes. Performance bounds of linear codes. ARQ protocols. This course offers an introduction to the theory of information and its applications to communication systems. Emphasis is given on the design, analysis and application of error detection and correction codes.

Learning Outcomes

  • The student will learn the foundations of information theory.
  • The student will be able to compute information that a source produces and examine the possibility to transmit it over a specific channel.
  • The student will be able to choose the most adequate compression algorithms.
  • The student will be able to evaluate the impact of the application of compression algorithms.
  • The student will be able to choose the most adequate error correction algorithms under specific noise conditions and transmission rate.

Prerequisite Courses

Not required.

Basic Textbooks

1. Δ. Βούκαλης, “Θεωρία πληροφοριών – Κώδικες”, ΣΤΕΛΛΑ ΠΑΡΙΚΟΥ & ΣΙΑ,2009 (in Greek).
2. Sam Shanmugan. “Ψηφιακά και Αναλογικά Συστήματα Επικοινωνίας”, Επιστημονικές και Τεχνολογικές Εκδόσεις Α.Γ.ΠΝΕΥΜΑΤΙΚΟΣ, 1979 (in Greek).

Additional References

1. S.Lin and D. Costello, “Error Control Coding”, Prentice Hall, 2004.

Teaching and Learning Methods

Activity Semester workload
Lectures 39 hours

 
Personal study 83 hours
 
Final exams 3 hours
Course total 125 hours (5 ECTS)

Student Performance Evaluation

Lectures.

Language of Instruction and Examinations

Greek, English (for Erasmus students)

Delivery Mode

Face-to-face.