Information Theory and Encoding (FSI-VTI-K)

Academic year 2021/2022
Supervisor: prof. Ing. Radomil Matoušek, Ph.D.  
Supervising institute: ÚAI all courses guaranted by this institute
Teaching language: Czech
Aims of the course unit:
The course objective is to make students familiar with the basics of the Theory of information and Coding theory. A key measure in information theory is "entropy". Applications of fundamental topics of information theory include lossless data compression and channel coding. Codes are used for data compression, cryptography, error-correction and more recently also for network coding..
Learning outcomes and competences:
The acquired knowledge will be sufficient for the good orientation in given principles of ICT.
Prerequisites:
Basic mathematical knowledge is required.
Course contents:
The course is aimed to basics in information theory (message, entropy, transfer of information, discrete and continuous channels) and signals (signal processing, modulation). Further the course includes basic overview of coding methods in areas: bar codes, compression codes, error correcting codes and cryptography. At the end of the course the modern trends in coding are presented (quantum error correction, quantum cryptography).
Teaching methods and criteria:
The course is taught through lectures explaining the basic principles and theory of the discipline. Exercises are focused on practical topics presented in lectures.
Assesment methods and criteria linked to learning outcomes:
The active participation and mastering the assigned task.
Controlled participation in lessons:
Solving an extra assignment can compensate absence.
Type of course unit:
    Guided consultation in combined form of studies  1 × 17 hrs. compulsory                  
    Guided consultation  1 × 35 hrs. optionally                  
Course curriculum:
    Guided consultation in combined form of studies 1. Introduction to the information theory 1/2 (information, entropy, mutual information).
2. Introduction to the information theory 2/2 (channel capacity, noisy-channel coding theorem).
3. Basic principle of communication (model of discrete channel).
4. Introduction to encoding theory.
5. Bar Code. RFID technology.
6. Data compression I.
7. Data compression II.
8. Error detection and correction I.
9. Error detection and correction II.
10. Cryptogaphy I.
11. Cryptogaphy II.
12. Cryptogaphy III.
13. Advanced in encoding and cryptography theory (quantum cryptography).
    Guided consultation Computer labs (exercises) are consistent with the content of lectures. The aim of the labs is to introduce students to practical part of the course above all using Matlab/Simulink system.
The labs are divided into six parts:
a) Bit rate, channel capacity, information ratio.
b) Signals, modulation methods.
c) Bar code.
d) Data compression.
e) Error detection and correction.
f) Cryptography.
Literature - fundamental:
1. USHER M.J.,GUY C.G,: Information and Communication for Engineers, , 0
2. SIMMOND A.: Data Communication and Transmission Principles, , 0
3. TERRELL T.J.,SHARK K.L.: Digital Signal Processing, , 0
4. Lubbe J.C.A.: Information Theory, Cambridge University Press, 1997
Literature - recommended:
1. Ošmera P.: Informační systémy, , 0
2. Ošmera P.: Mikroprocesorová technika a informační systémy, , 0
3. Přibyl J.,Kodl J.: Ochrana dat v informatice, , 0
4. Lubbe J.C.A.: Information Theory, Cambridge University Press, 1997
The study programmes with the given course:
Programme Study form Branch Spec. Final classification   Course-unit credits     Obligation     Level     Year     Semester  
B3S-K combined study B-AIŘ Applied Computer Science and Control -- Cr,Ex 4 Compulsory 1 3 W
N-AIŘ-K combined study --- no specialisation -- Cr,Ex 4 Compulsory 2 1 W