Print

2022　Advanced Artificial Intelligence

Font size  SML

Register update notification mail Add to favorite lecture list
Academic unit or major
Graduate major in Artificial Intelligence
Instructor(s)
Ono Isao 
Class Format
Lecture    (HyFlex)
Media-enhanced courses
Day/Period(Room No.)
Tue3-4(J221)  Fri3-4(J221)  
Group
-
Course number
ART.T548
Credits
2
Academic year
2022
Offered quarter
3Q
Syllabus updated
2022/4/20
Lecture notes updated
-
Language used
English
Access Index

Course description and aims

This course teaches advanced technologies of artificial intelligence. This course consists of two parts. The topics of the first part include evolutionary computation. In the second part, students will learn reinforcement learning. Both techniques have a feature that they can find good solutions or strategies by trial and error. The aims of this course is to enable students 1) to acquire knowledge on evolutionary computation and reinforcement learning, and 2) to apply the knowledge to solve real-world problems.

Student learning outcomes

By the end of this course, students will learn the following:
1) Evolutionary computation techniques and how to apply them to real-world problems.
2) Reinforcement learning techniques and how to apply them to real-world problems.

Keywords

evolutionary computation,black-box optimization, multiobjective optimization, reinforcement learning, value-based methods, policy-based methods, deep reinforcement learning

Competencies that will be developed

✔ Specialist skills Intercultural skills Communication skills Critical thinking skills Practical and/or problem-solving skills

Class flow

Every class consists of a lecture using the slides and the exercise.

Course schedule/Required learning

  Course schedule Required learning
Class 1 Introduction to evolutionary computation Understand the aim of the course and foundation of evolutionary computation.
Class 2 Evolutionary computation for function optimization: Genetic algorithms Understand function optimization and genetic algorithms.
Class 3 Evolutionary computation for function optimization : Evolution strategies Understand evolution strategies.
Class 4 Evolutionary computation for combinatorial optimization:Genetic algorithms Understand genetic algorithms for combinatorial optimization.
Class 5 Evolutionary computation for discrete optimization : Estimation of distribution algorithms Understand estimation of distribution algorithms for black-box discrete function optmization.
Class 6 Evolutionary computation for Globally multimodal optimization Understand global multimodality and evolutionary computation for globally multimodal optmization.
Class 7 Evolutionary computation for multiobjective optimization Understand multiobjective optimization and evolutionary multiobjective optimization.
Class 8 Introduction to reinforcement learning Understand foundation of reinforcement learning.
Class 9 Deep neural networks Understand deep neural networks.
Class 10 Deep Q-Network (DQN) Understand the Deep-Q Network (DQN).
Class 11 Improvement of DQN Understand the improved variants of DQN.
Class 12 Policy gradient and actor-critic methods Understand REINFORCE, Natural Actor-Critic (NAC), and Asynchronous Advantage Actor-Critic (A3C).
Class 13 Deep reinforcement learning for continuous action spaces Understand Deep Deterministic Policy Gradient (DDPG), Twin Delayed Deterministic Policy Gradient (TD3), and Soft Actor-Critic (SAC).
Class 14 Trust Region Policy Optimization and Proximal PolicyOptimization Understand Trust Region Policy Optimization and Proximal PolicyOptimization.

Out-of-Class Study Time (Preparation and Review)

To enhance effective learning, students are encouraged to spend approximately 100 minutes preparing for class and another 100 minutes reviewing class content afterwards (including assignments) for each class.
They should do so by referring to textbooks and other course material.

Textbook(s)

No textbook is set. Materials are distributed before each lesson.

Reference books, course materials, etc.

Artificial Intelligence - A Modern Approach (Third Edition, Prentice Hall), and so on.

Assessment criteria and methods

Students’ scores are based on assignment.

Related courses

  • ZUS.I301 ： Introduction to Artificial Intelligence

Prerequisites (i.e., required knowledge, skills, courses, etc.)

It is desiarble that studens have programming experience in Java and Python.

Page Top