Students learn fundamental knowledge from information theory.
They can assume the basic models of information, and learn several theories such as various codings (Prefix coding, Huffman coding, Elias coding, Ziv-Lempel coding), the fundamental theorem of channel capacity, forward error correction (Linear Block code, cyclic code, convolutional code, LDPC code), and basic encryption (Public key).
Students can gain an understanding of and acquire knowledge of fundamental theories of information coding, compression, channel capacity, various forward error corrections, and encryption.
Corresponding educational goals are:
(1) Specialist skills Fundamental specialist skills
(4) Applied skills (inquisitive thinking and/or problem-finding skills) Organization and analysis
(7) Skills acquiring a wide range of expertise, and expanding it into more advanced and other specialized areas
information code, information compression, channel capacity, forward error correction, encryption
Specialist skills | Intercultural skills | Communication skills | ✔ Critical thinking skills | Practical and/or problem-solving skills |
✔ ・Applied specialist skills on EEE |
At the beginning of each class, answers to the exercises from the last class are explained. Next, the instructor lectures on the material for that class. Towards the end of the class, students are given time for exercise problems.
Before class, the texts are uploaded to the OCW-i web site. Students should download them, and briefly read them. After class, they are requested to read the texts for understanding the class material.
Course schedule | Required learning | |
---|---|---|
Class 1 | Introduction to Information Theory: Model, Amount of Information, Entropy | Read Chapter 1-2 of the textbook. Read through Text (Class 1) on OCW-i before lecture, and review after it. |
Class 2 | Information code (Information coding, Prefix coding, Source coding theorem) | Read Chapter 3 of the textbook. Read through Text (Class 2) on OCW-i before lecture, and review after it. |
Class 3 | Data compression (1st half) | Read 1st half of Chapter 4 of the textbook. Read through Text (Class 3) on OCW-i before lecture, and review after it. |
Class 4 | Data compression (2nd half) | Read 2nd half of Chapter 4 of the textbook. Read through Text (Class 4) on OCW-i before lecture, and review after it. |
Class 5 | Channel Capacity (Probability Model, Amount of Mutual Information, Channel Capacity) | Read Chapter 5 of the textbook. Read through Text (Class 5) on OCW-i before lecture, and review after it. |
Class 6 | Channel coding (Channel coding Theorem, Repetition Code) | Read Chapter 5 of the textbook. Read Section 6.1-6.2 of the textbook. Read through Text (Class 6) on OCW-i before lecture, and review after it. |
Class 7 | Mid-term examination about Information Theory | Contents from 1st to 6th lectures. |
Class 8 | Forward Error Correction (Linear Block Code) | Read Section 6.3-6.4 of the textbook. Read through Text (Class 9) on OCW-i before lecture, and review after it. |
Class 9 | Forward Error Correction (Cyclic code, Convolutional Code) | Read Section 6.5 of the textbook. Read through Text (Class 10) on OCW-i before lecture, and review after it. |
Class 10 | Forward Error Correction (LDPC Code) | Read Section 6.6 of the textbook. Read through Text (Class 11) on OCW-i before lecture, and review after it. |
Class 11 | Continuous Channel | Read Chapter 7 of the textbook. Read through Text (Class 12) on OCW-i before lecture, and review after it. |
Class 12 | Fundamental Theory of Encryption | Read Section 8.1-8.2 of the textbook. Read through Text (Class 13) on OCW-i before lecture, and review after it. |
Class 13 | Examples of Encryption (Symmetric Encryption, Hash Function. Public Key Encryption) | Read Section 8.3-8.7 of the textbook. Read through Text (Class 14) on OCW-i before lecture, and review after it. |
Class 14 | Examination | Contents from 8th to 13th lectures. |
To enhance effective learning, students are encouraged to spend approximately 100 minutes preparing for class and another 100 minutes reviewing class content afterwards (including assignments) for each class.
They should do so by referring to textbooks and other course material.
Kohichi Sakaniwa, Kenta Kasai, "Introduction to Communication Theory" (in Japanese), Corona Publishing Co., Ltd.
Tomohiko Uematsu, "イラストで学ぶ情報理論の考え方"(in Japanese), Kodansha
Evaluate the level to which students understand the fundamentals of optical communication systems and component technologies.
40% for midterm, 40% for final examinations, and 20% for exercises.
Students should have the fundamental knowledge of Mathematics for 1st and 2nd Grade of undergraduate school.