Students learn fundamental knowledge from information theory.
They can assume the basic models of information, and learn several theories such as various codings (Prefix coding, Huffman coding, Elias coding, Ziv-Lempel coding), the fundamental theorem of channel capacity, forward error correction (Linear Block code, cyclic code, convolutional code, LDPC code), and basic encryption (Public key).
Students can gain an understanding of and acquire knowledge of fundamental theories of information coding, compression, channel capacity, various forward error corrections, and encryption.
Corresponding educational goals are:
(1) Specialist skills Fundamental specialist skills
(4) Applied skills (inquisitive thinking and/or problem-finding skills) Organization and analysis
(7) Skills acquiring a wide range of expertise, and expanding it into more advanced and other specialized areas
information code, information compression, channel capacity, forward error correction, encryption
Intercultural skills | Communication skills | ✔ Specialist skills | ✔ Critical thinking skills | Practical and/or problem-solving skills |
At the beginning of each class, answers to the exercises from the last class are explained. Next, the instructor lectures on the material for that class. Towards the end of the class, students are given time for exercise problems.
Before class, the texts are uploaded to the OCW-i web site. Students should download them, and briefly read them. After class, they are requested to read the texts for understanding the class material.
Course schedule | Required learning | |
---|---|---|
Class 1 | Introduction to Information Theory: Model, Amount of Information, Entropy | Read Chapter 1-2 of the textbook. Read through Text (Class 1) on OCW-i before lecture, and review after it. |
Class 2 | Information code (Information coding, Prefix coding, Source coding theorem) | Read Chapter 3 of the textbook. Read through Text (Class 2) on OCW-i before lecture, and review after it. |
Class 3 | Data compression (Huffman Coding) | Read Section 4.2 of the textbook. Read through Text (Class 3) on OCW-i before lecture, and review after it. |
Class 4 | Data compression (Elias coding) | Read Section 4.3-4.4 of the textbook. Read through Text (Class 4) on OCW-i before lecture, and review after it. |
Class 5 | Data compression (Ziv-Lempel Coding) | Read Section 4.5 of the textbook. Read through Text (Class 4) on OCW-i before lecture, and review after it. |
Class 6 | Channel Capacity (Probability Model, Amount of Mutual Information, Channel Capacity) | Read Chapter 5 of the textbook. Read through Text (Class 5) on OCW-i before lecture, and review after it. |
Class 7 | Channel coding (Channel coding Theorem, Repetition Code) | Read Section 6.1-6.2 of the textbook. Read through Text (Class 6) on OCW-i before lecture, and review after it. |
Class 8 | Practice about Information Theory | Read Chapter 1-Section6.2 of the textbook. Read through Text (Class 1-7) on OCW-i before lecture. |
Class 9 | Forward Error Correction (Linear Block Code) | Read Section 6.3-6.4 of the textbook. Read through Text (Class 9) on OCW-i before lecture, and review after it. |
Class 10 | Forward Error Correction (Cyclic code, Convolutional Code) | Read Section 6.5 of the textbook. Read through Text (Class 10) on OCW-i before lecture, and review after it. |
Class 11 | Forward Error Correction (LDPC Code) | Read Section 6.6 of the textbook. Read through Text (Class 11) on OCW-i before lecture, and review after it. |
Class 12 | Continuous Channel | Read Chapter 7 of the textbook. Read through Text (Class 12) on OCW-i before lecture, and review after it. |
Class 13 | Fundamental Theory of Encryption | Read Section 8.1-8.2 of the textbook. Read through Text (Class 13) on OCW-i before lecture, and review after it. |
Class 14 | Examples of Encryption (Symmetric Encryption, Hash Function) | Read Section 8.3-8.7 of the textbook. Read through Text (Class 14) on OCW-i before lecture, and review after it. |
Class 15 | Examples of Encryption (Public Key Encryption) | Read Section 8.3-8.7 of the textbook. Read through Text (Class 14) on OCW-i before lecture, and review after it. |
Kohichi Sakaniwa, Kenta Kasai, "Introduction to Communication Theory" (in Japanese), Corona Publishing Co., Ltd.
Tomohiko Uematsu, "イラストで学ぶ情報理論の考え方"(in Japanese), Kodansha
Evaluate the level to which students understand the fundamentals of optical communication systems and component technologies.
40% for midterm, 40% for final examinations, and 20% for exercises.
Students should have the fundamental knowledge of Mathematics for 1st and 2nd Grade of undergraduate school.