▶Japanese
Post to SNS
- Home
- > School of Computing
- > Graduate major in Artificial Intelligence
- > Multimedia Information Processing
- School of Science
-
School of Engineering
- Undergraduate major in Mechanical Engineering
- Undergraduate major in Systems and Control Engineering
- Undergraduate major in Electrical and Electronic Engineering
- Undergraduate major in Information and Communications Engineering
- Undergraduate major in Industrial Engineering and Economics
- Common courses
- School of Materials and Chemical Technology
- School of Computing
- School of Life Science and Technology
- School of Environment and Society
- 工学院，物質理工学院，環境・社会理工学院共通科目
- Liberal arts and basic science courses
- First-Year Courses
- School of Science
- School of Engineering
- School of Materials and Chemical Technology
- School of Computing
- School of Life Science and Technology
-
School of Environment and Society
- Department of Architecture and Building Engineering
- Department of Civil and Environmental Engineering
- Department of Transdisciplinary Science and Engineering
- Department of Social and Human Sciences
- Department of Innovation Science
- Graduate major in Technology and Innovation Management
- Common courses
- Liberal arts and basic science courses
- Academic unit or major
- Graduate major in Artificial Intelligence
- Instructor(s)
- Kamei Hiroyuki Shimosaka Masamichi Ako Takayuki
- Class Format
- Lecture
- Media-enhanced courses
- Day/Period(Room No.)
- Mon7-8(W631,G311) Thr7-8(W631,G311)
- Group
- -
- Course number
- ART.T547
- Credits
- 2
- Academic year
- 2017
- Offered quarter
- 2Q
- Syllabus updated
- 2017/3/17
- Lecture notes updated
- -
- Language used
- Japanese
- Access Index
-
Course description and aims
Multimedia includes a combination of many kinds of digital information such as still images, movies, audio, text, conventionally. It recently covers geographical information, biometric, and all of digital information. This course covers the fundamentals of signal processing, techniques of integrating and analyzing multi-modal information, and examples of applying multimedia to mobile phone and museum.
This course facilitates students' understanding of multimedia technology and development of their ability of multilateral ways of thinking.
Student learning outcomes
At the end of this course, students will be able to explain multimedia technology and to design a system using multimedia.
Keywords
Fourier transform, Fourier optics, wave equation, digital docummentation, mobile phone sensor, behavior understanding, open data, digital mueum, field museum
Competencies that will be developed
| ✔ Specialist skills | Intercultural skills | Communication skills | Critical thinking skills | Practical and/or problem-solving skills |
Class flow
At the beginning of each class, basic principles and fundamental strategies are explained.
Towards the end of the class, case studies and application examples are introduced.
In exercises, a group work will be carried out.
Course schedule/Required learning
| Course schedule | Required learning | |
|---|---|---|
| Class 1 | Fourier Transform | Review of Fourier Transform and Digital Fourier Transform. |
| Class 2 | Fourier Optics - Fresnel difraction, Fraunhofer difraction, and pinhole camera | Explain diffraction phenomena of tha light and image formation with a pinhole camera. |
| Class 3 | Fourier Optics - Function of Lens | Explain a function of optical lens and optical Fourier transform with a lens. |
| Class 4 | Image formation and Processing based on Wave equation | Derive an image formation algorithm from observed wave signals by use of Fourier transform of the wave equation. |
| Class 5 | Exercise problems of 2-dimensional Fourier transform | Solve exercise problems of 2-dimensional Fourier transform and make a presentation of the exercise. |
| Class 6 | Overview of mobile phone sensor data | Prepare overview of mobile phone sensor data |
| Class 7 | Behavior understanding from phone sensor data: indoor localization | Prepare overview of mobile phone indoor localization |
| Class 8 | Behavior understanding from phone sensor data: action recognition | Prepare overview of mobile phone based action recognition |
| Class 9 | Understanding multi-modal multimedia | Prepare overview of multi-modal multimedia understanding |
| Class 10 | Statistical methods for multi-modal multimedia recognition | Prepare overview of fundamental mathematical and statistical models for multi-modal multimedia recognition |
| Class 11 | Digital documentation of cultural resources | Explain about cultural resouces and utilization of thier digital data. |
| Class 12 | Database and Web technology | Explain how the "Database" has changed according to the progress of Web technology. |
| Class 13 | Opendata | Discuss about the influence of Opendata on culture and museum. |
| Class 14 | Museum and multimedia - application of multi-modal data | Explain how multi-modal multimedia is used in museum. |
| Class 15 | Museum and multimedia - Field museum | Investigate a relationship between multimedia and new type museums like Field museum or Geo-park |
Textbook(s)
None required.
Reference books, course materials, etc.
Handouts will be distributed.
Assessment criteria and methods
Three reports 90% (@30%), exercise (10%)
Related courses
- ART.T463 ： Computer Graphics
- ART.T460 ： Speech Information Processing
- CSC.T421 ： Human Computer Interaction
Prerequisites (i.e., required knowledge, skills, courses, etc.)
No prerequisites.
Other
None.
