2016 Multimedia Information Processing

Font size  SML

Register update notification mail Add to favorite lecture list
Academic unit or major
Graduate major in Artificial Intelligence
Kamei Hiroyuki  Shimosaka Masamichi  Ako Takayuki 
Class Format
Media-enhanced courses
Day/Period(Room No.)
Mon7-8(W631,G311)  Thr7-8(W631,G311)  
Course number
Academic year
Offered quarter
Syllabus updated
Lecture notes updated
Language used
Access Index

Course description and aims

Multimedia includes a combination of many kinds of digital information such as still images, movies, audio, text, conventionally. It recently covers geographical information, biometric, and all of digital information. This course covers the fundamentals of signal processing, techniques of integrating and analyzing multi-modal information, and examples of applying multimedia to mobile phone and museum.
This course facilitates students' understanding of multimedia technology and development of their ability of multilateral ways of thinking.

Student learning outcomes

At the end of this course, students will be able to explain multimedia technology and to design a system using multimedia.


Fourier transform, Fourier optics, wave equation, digital docummentation, mobile phone sensor, behavior understanding, open data, digital mueum, field museum

Competencies that will be developed

Specialist skills Intercultural skills Communication skills Critical thinking skills Practical and/or problem-solving skills

Class flow

At the beginning of each class, basic principles and fundamental strategies are explained.
Towards the end of the class, case studies and application examples are introduced.
In exercises, a group work will be carried out.

Course schedule/Required learning

  Course schedule Required learning
Class 1 Fourier Transform Review of Fourier Transform and Digital Fourier Transform.
Class 2 Fourier Optics - Fresnel difraction, Fraunhofer difraction, and pinhole camera Explain diffraction phenomena of tha light and image formation with a pinhole camera.
Class 3 Fourier Optics - Function of Lens Explain a function of optical lens and optical Fourier transform with a lens.
Class 4 Image formation and Processing based on Wave equation Derive an image formation algorithm from observed wave signals by use of Fourier transform of the wave equation.
Class 5 Exercise problems of 2-dimensional Fourier transform Solve exercise problems of 2-dimensional Fourier transform and make a presentation of the exercise.
Class 6 Overview of mobile phone sensor data Prepare overview of mobile phone sensor data
Class 7 Behavior understanding from phone sensor data: indoor localization Prepare overview of mobile phone indoor localization
Class 8 Behavior understanding from phone sensor data: action recognition Prepare overview of mobile phone based action recognition
Class 9 Understanding multi-modal multimedia Prepare overview of multi-modal multimedia understanding
Class 10 Statistical methods for multi-modal multimedia recognition Prepare overview of fundamental mathematical and statistical models for multi-modal multimedia recognition
Class 11 Digital documentation of cultural resources Explain about cultural resouces and utilization of thier digital data.
Class 12 Database and Web technology Explain how the "Database" has changed according to the progress of Web technology.
Class 13 Opendata Discuss about the influence of Opendata on culture and museum.
Class 14 Museum and multimedia - application of multi-modal data Explain how multi-modal multimedia is used in museum.
Class 15 Museum and multimedia - Field museum Investigate a relationship between multimedia and new type museums like Field museum or Geo-park


None required.

Reference books, course materials, etc.

Handouts will be distributed.

Assessment criteria and methods

Three reports 90% (@30%), exercise (10%)

Related courses

  • ART.T463 : Computer Graphics
  • ART.T460 : Speech Information Processing
  • CSC.T421 : Human Computer Interaction

Prerequisites (i.e., required knowledge, skills, courses, etc.)

No prerequisites.



Page Top