Print

2019　Communication Theory (Electrical and Electronic Engineering)

Font size  SML

Register update notification mail Add to favorite lecture list
Academic unit or major
Undergraduate major in Electrical and Electronic Engineering
Instructor(s)
Uenohara Hiroyuki  Aoyagi Takahiro 
Class Format
Lecture     
Media-enhanced courses
Day/Period(Room No.)
Mon7-8(S221)  Wed1-2(S221)  
Group
-
Course number
EEE.S341
Credits
2
Academic year
2019
Offered quarter
4Q
Syllabus updated
2019/3/18
Lecture notes updated
2020/3/17
Language used
Japanese
Access Index

Course description and aims

Students learn fundamental knowledge from information theory.
They can assume the basic models of information, and learn several theories such as various codings (Prefix coding, Huffman coding, Elias coding, Ziv-Lempel coding), the fundamental theorem of channel capacity, forward error correction (Linear Block code, cyclic code, convolutional code, LDPC code), and basic encryption (Public key).

Student learning outcomes

Students can gain an understanding of and acquire knowledge of fundamental theories of information coding, compression, channel capacity, various forward error corrections, and encryption.

Corresponding educational goals are:
(1) Specialist skills Fundamental specialist skills
(4) Applied skills (inquisitive thinking and/or problem-finding skills) Organization and analysis
(7) Skills acquiring a wide range of expertise, and expanding it into more advanced and other specialized areas

Keywords

information code, information compression, channel capacity, forward error correction, encryption

Competencies that will be developed

✔ Specialist skills Intercultural skills Communication skills ✔ Critical thinking skills Practical and/or problem-solving skills

Class flow

At the beginning of each class, answers to the exercises from the last class are explained. Next, the instructor lectures on the material for that class. Towards the end of the class, students are given time for exercise problems.
Before class, the texts are uploaded to the OCW-i web site. Students should download them, and briefly read them. After class, they are requested to read the texts for understanding the class material.

Course schedule/Required learning

  Course schedule Required learning
Class 1 Introduction to Information Theory: Model, Amount of Information, Entropy Read Chapter 1-2 of the textbook. Read through Text (Class 1) on OCW-i before lecture, and review after it.
Class 2 Information code (Information coding, Prefix coding, Source coding theorem) Read Chapter 3 of the textbook. Read through Text (Class 2) on OCW-i before lecture, and review after it.
Class 3 Data compression (Huffman Coding) Read Section 4.2 of the textbook. Read through Text (Class 3) on OCW-i before lecture, and review after it.
Class 4 Data compression (Elias coding) Read Section 4.3-4.4 of the textbook. Read through Text (Class 4) on OCW-i before lecture, and review after it.
Class 5 Data compression (Ziv-Lempel Coding) Read Section 4.5 of the textbook. Read through Text (Class 4) on OCW-i before lecture, and review after it.
Class 6 Channel Capacity (Probability Model, Amount of Mutual Information, Channel Capacity) Read Chapter 5 of the textbook. Read through Text (Class 5) on OCW-i before lecture, and review after it.
Class 7 Channel coding (Channel coding Theorem, Repetition Code) Read Section 6.1-6.2 of the textbook. Read through Text (Class 6) on OCW-i before lecture, and review after it.
Class 8 Practice about Information Theory Read Chapter 1-Section6.2 of the textbook. Read through Text (Class 1-7) on OCW-i before lecture.
Class 9 Forward Error Correction (Linear Block Code) Read Section 6.3-6.4 of the textbook. Read through Text (Class 9) on OCW-i before lecture, and review after it.
Class 10 Forward Error Correction (Cyclic code, Convolutional Code) Read Section 6.5 of the textbook. Read through Text (Class 10) on OCW-i before lecture, and review after it.
Class 11 Forward Error Correction (LDPC Code) Read Section 6.6 of the textbook. Read through Text (Class 11) on OCW-i before lecture, and review after it.
Class 12 Continuous Channel Read Chapter 7 of the textbook. Read through Text (Class 12) on OCW-i before lecture, and review after it.
Class 13 Fundamental Theory of Encryption Read Section 8.1-8.2 of the textbook. Read through Text (Class 13) on OCW-i before lecture, and review after it.
Class 14 Examples of Encryption (Symmetric Encryption, Hash Function) Read Section 8.3-8.7 of the textbook. Read through Text (Class 14) on OCW-i before lecture, and review after it.
Class 15 Examples of Encryption (Public Key Encryption) Read Section 8.3-8.7 of the textbook. Read through Text (Class 14) on OCW-i before lecture, and review after it.

Textbook(s)

Kohichi Sakaniwa, Kenta Kasai, "Introduction to Communication Theory" (in Japanese), Corona Publishing Co., Ltd.

Reference books, course materials, etc.

Tomohiko Uematsu, "イラストで学ぶ情報理論の考え方"(in Japanese), Kodansha

Assessment criteria and methods

Evaluate the level to which students understand the fundamentals of optical communication systems and component technologies.
40% for midterm, 40% for final examinations, and 20% for exercises.

Related courses

  • Signal System
  • Optoelectronics

Prerequisites (i.e., required knowledge, skills, courses, etc.)

Students should have the fundamental knowledge of Mathematics for 1st and 2nd Grade of undergraduate school.

Page Top