Print

2022　Communication Theory (ICT)

Font size  SML

Register update notification mail Add to favorite lecture list
Academic unit or major
Undergraduate major in Information and Communications Engineering
Instructor(s)
Fukawa Kazuhiko  Ogata Wakaha 
Class Format
Lecture    (Livestream)
Media-enhanced courses
Day/Period(Room No.)
Mon7-8(W323)  Thr7-8(W323)  
Group
-
Course number
ICT.C205
Credits
2
Academic year
2022
Offered quarter
2Q
Syllabus updated
2022/4/4
Lecture notes updated
-
Language used
Japanese
Access Index

Course description and aims

This course mainly focuses on source encoding and channel coding, which are two main subjects of the information theory. The source encoding can lead to data compression, whereas the channel coding can realize reliable data transmission. First, the basis of the probability theory is reviewed, and measures of the amount of information such as the entropy and the mutual information are defined. Then, two important relations are introduced; one is the relation between the limit of the data compression and the entropy, while the other is the relation between the limit of transmission speed of reliable data transmission and the maximum value of the mutual information. Some concrete methods of the channel coding and the fundamental encryption theory are also discussed in this course.

Student learning outcomes

At the end of this course, students will be able to:
1) regard information and channels as abstract mathematical models,
2) explain the relation between the limit of data compression and the entropy,
3) explain the relation between the limit of transmission speed of reliable data transmission and the maximum value of the mutual information,
4) explain basic methods of the source encoding, channel coding, and encryption.

Keywords

Source encoding, channel coding, entropy, source coding theorem, channel coding theorem, encryption

Competencies that will be developed

✔ Specialist skills Intercultural skills Communication skills Critical thinking skills Practical and/or problem-solving skills

Class flow

Students are provided with exercise problems about items explained in each class.

Course schedule/Required learning

  Course schedule Required learning
Class 1 Introduction: source encoding and channel coding Understand the course objectives.
Class 2 Representation of information and basis of the probability theory Review the basis of the probability theory.
Class 3 Entropy, mutual information, divergence Understand concepts you learn in the class.
Class 4 Model of information sources and entropy rate: stationary information source, Markov information source, entropy rate Understand concepts you learn in the class.
Class 5 Kraft's inequality, source coding theorem (converse part) Understand the converse part of the source coding theorem.
Class 6 The limit of average code length, Huffman coding Understand the limit of averate code length and Huffman coding.
Class 7 Source coding theorem (direct part) Understand the direct part of the source coding theorem.
Class 8 The midterm examination and the review of the first half Review the first half of this course.
Class 9 Model of channels Understand model of channels.
Class 10 Channel capacity Explain channel capacity.
Class 11 Channel coding theorem Understand the direct part of the channel coding theorem.
Class 12 Error correcting code: Humming code Understand error correcting code and the mechanism of Humming code
Class 13 Encryption theory: basics adn symmetric key encryption Understand the model of encryption.
Class 14 Encryption theory: public-key encryption, summarization of this course Understand the model of public-key encryption.

Out-of-Class Study Time (Preparation and Review)

To enhance effective learning, students are encouraged to spend approximately 100 minutes preparing for class and another 100 minutes reviewing class content afterwards (including assignments) for each class.
They should do so by referring to textbooks and other course material.

Textbook(s)

All materials used in class can be found on T2SCHOLA, or provided during class.

Reference books, course materials, etc.

Tomohiko Uematsu, An Illustrated Guide to Viewpoint of Information Theory, Ormsha, 2010 (Japanese)
Kohichi Sakaniwa, Kenta Kasai, Introduction to Communication Theory, CORONA PUBLISHING CO., LTD, 2014 (Japanese)

Assessment criteria and methods

Student achievements are assessed based on the midterm exam (50%) and the final exam (50%).
Note that when the online lecture is held, the above exams can be replaced by reports, and the course schedule will be changed accordingly.

Related courses

  • ICT.C201 ： Introduction to Information and Communications Engineering
  • ICT.S206 ： Signal and System Analysis
  • ICT.C209 ： Algebraic Systems and Coding Theory

Prerequisites (i.e., required knowledge, skills, courses, etc.)

none required

Page Top