Print

2016　Mathematical Statistics

Font size  SML

Register update notification mail Add to favorite lecture list
Academic unit or major
Undergraduate major in Mathematical and Computing Science
Instructor(s)
Suzuki Taiji  Kabashima Yoshiyuki  Nomura Shunichi 
Class Format
Lecture / Exercise     
Media-enhanced courses
Day/Period(Room No.)
Tue3-4(W833)  Fri3-4(W833)  Fri7-8(W833)  
Group
-
Course number
MCS.T223
Credits
3
Academic year
2016
Offered quarter
3Q
Syllabus updated
2016/4/27
Lecture notes updated
-
Language used
Japanese
Access Index

Course description and aims

This course gives a standard introduction to mathematical statistics. In the estimation theory, starting from linear regression, the methodologies and properties of estimators such as the maximal likelihood estimator and the Bayes estimator will be explained. Following the estimation theory, the test theory will be taught. In the test theory, several tests such as two sample test, independence test, and analysis of variance will be explained. Throughout the course, optimalities of the estimation methods and the tests will be discussed based on the statistical decision theory.

Student learning outcomes

Statistics is a methodology to deduce useful knowledge from data to help decision making. Through this course, the students should learn the basics of the mathematical statistics and several methods of statistics. Finally, it is expected that the students will be able to use the statistical methods. It is also expected that by learning statistics, the students will learn knowledge that is also useful for other fields such as machine learning and signal processing.

Keywords

mathematical statistics, linear regression, maximum likelihood estimator, Bayes estimator, unbiased estimator, Cramer-Rao inequality, Fisher information, asymptotics, decision theory, test, two sample test, independence test, analysis of variance, confidence interval

Competencies that will be developed

✔ Specialist skills Intercultural skills Communication skills Critical thinking skills ✔ Practical and/or problem-solving skills

Class flow

The course consists of lecture and exercise. In the lecture, the contents will be explained mainly using a black board. In the exercise, the students should solve problems and submit reports.

Course schedule/Required learning

  Course schedule Required learning
Class 1 Outline of the course and basics of probability theory Understand the basics of probability theory that is a basis of statistics
Class 2 Simple linear regression Learn simple linear regression, understand least squares estimator, determination coefficient and so on.
Class 3 Exercise Solve problems related to the last two lectures.
Class 4 Multiple linear regression Understand multiple linear regression.
Class 5 Properties of multiple linear regression Learn some properties of multiple linear regression such as unbiasedness, the magnitude of variance, and so on.
Class 6 Exercise Solve problems related to the last two lectures.
Class 7 Unbiased estimator and Cramer-Rao inequality Learn Cramer-Rao inequality and Fisher information matrix that characterize the optimality of unbiased estimators.
Class 8 Sufficient statistics Understand sufficient statistics and the optimality condition of unbiased estimators given by sufficient statistics.
Class 9 Exercise Solve problems related to the last two lectures.
Class 10 Maximum likelihood estimator Learn the definition of the maximum likelihood estimator, and learn to be derive the maximum likelihood estimator on some statistical models.
Class 11 Consistency and asymptotic normality Learn the consistency and asymptotic normality of the maximum likelihood estimator.
Class 12 Exercise Solve problems related to the last two lectures.
Class 13 Bayes estimator Learn the definition of the Bayes estimator and to be able to derive the Bayes estimator on several statistical models.
Class 14 Some properties of the Bayes estimator: admissibility, minimax optimality, and others Learn some concepts of the statistical decision theory such as admissibility and minimax optimality and understand when the Bayes estimator satisfies those properties.
Class 15 Exercise Solve problems related to the last two lectures.
Class 16 Discriminant analysis Learn the concept of discriminant analysis.
Class 17 Test Learn the concept of test, and some simple examples of tests.
Class 18 Exercise Solve problems related to the last two lectures.
Class 19 Neyman–Pearson lemma Learn Neyman-Pearson Lemma that characterizes the optimality of tests.
Class 20 Chi-square test Learn chi-square test and understand the likelihood test is asymptotically chi-square test.
Class 21 Exercise Solve problems related to the last two lectures.
Class 22 Analysis of variance Learn the concept of analysis of variance and to be able to use analysis of variance in practice.

Textbook(s)

Nobuo Inagaki "Mathematical statistics"

Reference books, course materials, etc.

Unspecified.

Assessment criteria and methods

Learning achievement is evaluated by report (50%) and the final exam (50%).

Related courses

  • MCS.T212 ： Fundamentals of Probability
  • MCS.T332 ： Data Analysis

Prerequisites (i.e., required knowledge, skills, courses, etc.)

No prerequisites, but it is expected that the students know the basics of the probability theory as taught in the course of "Fundamentals of Probability".

Page Top