2019 Communication Theory (ICT)

Font size  SML

Register update notification mail Add to favorite lecture list
Academic unit or major
Undergraduate major in Information and Communications Engineering
Instructor(s)
Fukawa Kazuhiko  Ogata Wakaha 
Course component(s)
Lecture
Day/Period(Room No.)
Mon7-8(S421)  Thr7-8(S421)  
Group
-
Course number
ICT.C205
Credits
2
Academic year
2019
Offered quarter
2Q
Syllabus updated
2019/4/9
Lecture notes updated
2019/8/1
Language used
Japanese
Access Index

Course description and aims

This course mainly focuses on source encoding and channel coding, which are two main subjects of the information theory. The source encoding can lead to data compression, whereas the channel coding can realize reliable data transmission. First, the basis of the probability theory is reviewed, and measures of the amount of information such as the entropy and the mutual information are defined. Then, two important relations are introduced; one is the relation between the limit of the data compression and the entropy, while the other is the relation between the limit of transmission speed of reliable data transmission and the maximum value of the mutual information. Some concrete methods of the channel coding and the fundamental encryption theory are also discussed in this course.

Student learning outcomes

At the end of this course, students will be able to:
1) regard information and channels as abstract mathematical models,
2) explain the relation between the limit of data compression and the entropy,
3) explain the relation between the limit of transmission speed of reliable data transmission and the maximum value of the mutual information,
4) explain basic methods of the source encoding, channel coding, and encryption.

Keywords

Source encoding, channel coding, entropy, source coding theorem, channel coding theorem, encryption

Competencies that will be developed

Intercultural skills Communication skills Specialist skills Critical thinking skills Practical and/or problem-solving skills
- - - -

Class flow

Students are provided with exercise problems about items explained in each class.

Course schedule/Required learning

  Course schedule Required learning
Class 1 Introduction: source encoding and channel coding Understand the course objectives.
Class 2 Representation of information and basis of the probability theory Review the basis of the probability theory.
Class 3 Entropy, mutual information, divergence Understand concepts you learn in the class.
Class 4 Model of information sources and entropy rate: stationary information source, Markov information source, entropy rate Understand concepts you learn in the class.
Class 5 Kraft's inequality, source coding theorem (converse part) Understand the converse part of the source coding theorem.
Class 6 The limit of average code length, Huffman coding Understand the limit of averate code length and Huffman coding.
Class 7 Source coding theorem (direct part) Understand the direct part of the source coding theorem.
Class 8 The midterm examination and the review of the first half Review the first half of this course.
Class 9 Model of channels Understand model of channels.
Class 10 Channel capacity Explain channel capacity.
Class 11 Channel coding theorem (direct part) Understand the direct part of the channel coding theorem.
Class 12 Channel coding theorem (converce part) Understand the converse part of the channel coding theorem.
Class 13 Error correcting code: Humming code Understand error correcting code and the mechanism of Humming code
Class 14 Encryption theory: symmetric key encryption and public-key encryption Understand the model of encryption.
Class 15 Concrete cryptosystems Understand the mechanism of concrete cryptosystems.

Textbook(s)

All materials used in class can be found on OCW-i, or provided during class.

Reference books, course materials, etc.

Tomohiko Uematsu, An Illustrated Guide to Viewpoint of Information Theory, Ormsha, 2010 (Japanese)
Kohichi Sakaniwa, Kenta Kasai, Introduction to Communication Theory, CORONA PUBLISHING CO., LTD, 2014 (Japanese)

Assessment criteria and methods

Student achievements are assessed based on the midterm exam (50%) and the final exam (50%).

Related courses

  • ICT.C201 : Introduction to Information and Communications Engineering
  • ICT.S206 : Signal and System Analysis
  • ICT.C209 : Algebraic Systems and Coding Theory

Prerequisites (i.e., required knowledge, skills, courses, etc.)

none required

Page Top