Multimedia includes a combination of many kinds of digital information such as still images, movies, audio, text, conventionally. It recently covers geographical information, biometric, and all of digital information. This course covers the fundamentals of signal processing, techniques of integrating and analyzing multi-modal information, and examples of applying multimedia to mobile phone and museum.
This course facilitates students' understanding of multimedia technology and development of their ability of multilateral ways of thinking.
At the end of this course, students will be able to explain multimedia technology and to design a system using multimedia.
Fourier transform, Fourier optics, wave equation, digital docummentation, mobile phone sensor, behavior understanding, open data, digital mueum, field museum
|✔ Specialist skills||Intercultural skills||Communication skills||Critical thinking skills||Practical and/or problem-solving skills|
At the beginning of each class, basic principles and fundamental strategies are explained.
Towards the end of the class, case studies and application examples are introduced.
In exercises, a group work will be carried out.
|Course schedule||Required learning|
|Class 1||Fourier Transform||Review of Fourier Transform and Digital Fourier Transform.|
|Class 2||Fourier Optics - Fresnel difraction, Fraunhofer difraction, and pinhole camera||Explain diffraction phenomena of tha light and image formation with a pinhole camera.|
|Class 3||Fourier Optics - Function of Lens||Explain a function of optical lens and optical Fourier transform with a lens.|
|Class 4||Image formation and Processing based on Wave equation||Derive an image formation algorithm from observed wave signals by use of Fourier transform of the wave equation.|
|Class 5||Exercise problems of 2-dimensional Fourier transform||Solve exercise problems of 2-dimensional Fourier transform and make a presentation of the exercise.|
|Class 6||Overview of mobile phone sensor data||Prepare overview of mobile phone sensor data|
|Class 7||Behavior understanding from phone sensor data: indoor localization||Prepare overview of mobile phone indoor localization|
|Class 8||Behavior understanding from phone sensor data: action recognition||Prepare overview of mobile phone based action recognition|
|Class 9||Understanding multi-modal multimedia||Prepare overview of multi-modal multimedia understanding|
|Class 10||Statistical methods for multi-modal multimedia recognition||Prepare overview of fundamental mathematical and statistical models for multi-modal multimedia recognition|
|Class 11||Digital documentation of cultural resources||Explain about cultural resouces and utilization of thier digital data.|
|Class 12||Database and Web technology||Explain how the "Database" has changed according to the progress of Web technology.|
|Class 13||Opendata||Discuss about the influence of Opendata on culture and museum.|
|Class 14||Museum and multimedia - application of multi-modal data||Explain how multi-modal multimedia is used in museum.|
|Class 15||Museum and multimedia - Field museum||Investigate a relationship between multimedia and new type museums like Field museum or Geo-park|
Handouts will be distributed.
Three reports 90% (@30%), exercise (10%)