Print

2021　Communication Theory (Electrical and Electronic Engineering)

Font size  SML

Register update notification mail Add to favorite lecture list
Academic unit or major
Undergraduate major in Electrical and Electronic Engineering
Instructor(s)
Aoyagi Takahiro  Tran Gia Khanh 
Class Format
Lecture     
Media-enhanced courses
Day/Period(Room No.)
Tue1-2(S221)  Fri1-2(S221)  
Group
-
Course number
EEE.S341
Credits
2
Academic year
2021
Offered quarter
4Q
Syllabus updated
2021/4/27
Lecture notes updated
-
Language used
Japanese
Access Index

Course description and aims

Students learn fundamental knowledge from information theory.
They can assume the basic models of information, and learn several theories such as various codings (Prefix coding, Huffman coding, Elias coding, Ziv-Lempel coding), the fundamental theorem of channel capacity, forward error correction (Linear Block code, cyclic code, convolutional code, LDPC code), and basic encryption (Public key).

Student learning outcomes

Students can gain an understanding of and acquire knowledge of fundamental theories of information coding, compression, channel capacity, various forward error corrections, and encryption.

Corresponding educational goals are:
(1) Specialist skills Fundamental specialist skills
(4) Applied skills (inquisitive thinking and/or problem-finding skills) Organization and analysis
(7) Skills acquiring a wide range of expertise, and expanding it into more advanced and other specialized areas

Keywords

information code, information compression, channel capacity, forward error correction, encryption

Competencies that will be developed

Specialist skills Intercultural skills Communication skills ✔ Critical thinking skills Practical and/or problem-solving skills
✔ ・Applied specialist skills on EEE

Class flow

At the beginning of each class, answers to the exercises from the last class are explained. Next, the instructor lectures on the material for that class. Towards the end of the class, students are given time for exercise problems.
Before class, the texts are uploaded to the OCW-i web site. Students should download them, and briefly read them. After class, they are requested to read the texts for understanding the class material.

Course schedule/Required learning

  Course schedule Required learning
Class 1 Introduction to Information Theory: Model, Amount of Information, Entropy Read Chapter 1-2 of the textbook. Read through Text (Class 1) on OCW-i before lecture, and review after it.
Class 2 Information code (Information coding, Prefix coding, Source coding theorem) Read Chapter 3 of the textbook. Read through Text (Class 2) on OCW-i before lecture, and review after it.
Class 3 Data compression (1st half) Read 1st half of Chapter 4 of the textbook. Read through Text (Class 3) on OCW-i before lecture, and review after it.
Class 4 Data compression (2nd half) Read 2nd half of Chapter 4 of the textbook. Read through Text (Class 4) on OCW-i before lecture, and review after it.
Class 5 Channel Capacity (Probability Model, Amount of Mutual Information, Channel Capacity) Read Chapter 5 of the textbook. Read through Text (Class 5) on OCW-i before lecture, and review after it.
Class 6 Channel coding (Channel coding Theorem, Repetition Code) Read Chapter 5 of the textbook. Read Section 6.1-6.2 of the textbook. Read through Text (Class 6) on OCW-i before lecture, and review after it.
Class 7 Mid-term examination about Information Theory Contents from 1st to 6th lectures.
Class 8 Forward Error Correction (Linear Block Code) Read Section 6.3-6.4 of the textbook. Read through Text (Class 9) on OCW-i before lecture, and review after it.
Class 9 Forward Error Correction (Cyclic code, Convolutional Code) Read Section 6.5 of the textbook. Read through Text (Class 10) on OCW-i before lecture, and review after it.
Class 10 Forward Error Correction (LDPC Code) Read Section 6.6 of the textbook. Read through Text (Class 11) on OCW-i before lecture, and review after it.
Class 11 Continuous Channel Read Chapter 7 of the textbook. Read through Text (Class 12) on OCW-i before lecture, and review after it.
Class 12 Fundamental Theory of Encryption Read Section 8.1-8.2 of the textbook. Read through Text (Class 13) on OCW-i before lecture, and review after it.
Class 13 Examples of Encryption (Symmetric Encryption, Hash Function. Public Key Encryption) Read Section 8.3-8.7 of the textbook. Read through Text (Class 14) on OCW-i before lecture, and review after it.
Class 14 Examination Contents from 8th to 13th lectures.

Out-of-Class Study Time (Preparation and Review)

To enhance effective learning, students are encouraged to spend approximately 100 minutes preparing for class and another 100 minutes reviewing class content afterwards (including assignments) for each class.
They should do so by referring to textbooks and other course material.

Textbook(s)

Kohichi Sakaniwa, Kenta Kasai, "Introduction to Communication Theory" (in Japanese), Corona Publishing Co., Ltd.

Reference books, course materials, etc.

Tomohiko Uematsu, "イラストで学ぶ情報理論の考え方"(in Japanese), Kodansha

Assessment criteria and methods

Evaluate the level to which students understand the fundamentals of optical communication systems and component technologies.
40% for midterm, 40% for final examinations, and 20% for exercises.

Related courses

  • Signal System
  • Optoelectronics

Prerequisites (i.e., required knowledge, skills, courses, etc.)

Students should have the fundamental knowledge of Mathematics for 1st and 2nd Grade of undergraduate school.

Page Top