2019　Statistical Signal Processing

Font size  SML

Undergraduate major in Information and Communications Engineering
Instructor(s)
Yamaguchi Masahiro  Obi Takashi
Course component(s)
Lecture
Day/Period(Room No.)
Tue1-2(S621)  Fri1-2(S621)
Group
-
Course number
ICT.S307
Credits
2
2019
Offered quarter
2Q
Syllabus updated
2019/3/18
Lecture notes updated
2019/8/11
Language used
Japanese
Access Index Course description and aims

Statistical signal processing is an indispensable technology in processing of signal containing noise, and widely utilized in various fields, such as information communication, measurement and control systems, imaging, voice, and medical field.
Based on the knowledge of linear algebra and statistics learned in previous lectures, this course deals with the mathematical theory that is necessary for advanced signal and image processing.
Topics include the probabilistic model of noise, statistical meaning of least square estimate, maximum-likelihood estimation, Bayesian estimation, EM algorithm and linear dynamical systems.

Student learning outcomes

Through the lectures, the students will be able to:
1) Understand basis of statistical signal processing theory such as linear estimation method and maximum likelihood estimation.
2) Learn the parameter estimation technique for observation system containing statistical noise and be applied the technique to the information communication engineering research.

Keywords

Random vector, probability distribution function, linear inverse problem, maximum likelihood estimate, linear least square estimation, regularization, ill-conditioned system, Bayesian estimation, EM algorithm, Kalman filter

Competencies that will be developed

 ✔ Specialist skills Intercultural skills Communication skills ✔ Critical thinking skills ✔ Practical and/or problem-solving skills

Class flow

Two lectures are given in every week.

Course schedule/Required learning

Course schedule Required learning
Class 1 Statistics in signal processing Why is statistics necessary in signal processing?
Class 2 Multivariate probability distribution, random vectors Represent signal and noise with random variables. Derive the statistics of linearly transformed random variables.
Class 3 Multidimensional normal distribution Explain the meaning of the eivenvalue decomposition of covariance matrix in multidimensional normal distribution.
Class 4 Estimation of unknown quantities, maximum likelihood estimate Estimate the statistics of a random vector by maximum likelihood principle.
Class 5 Linear inverse problem and least square method Derive the least square solution in linear inverse problem.
Class 6 Noise response Derive the error in least square solution when observed data contain noise.
Class 7 Estimate using regularization Explain estimation methods that are robust against noise.
Class 8 Estimation in ill-conditioned system What is minimum-norm estimate?
Class 9 Bayesian estimation Understand the relationship between prior distribution and posterior distribution and explain the difference between Bayesian estimation and maximum likelihood estimation.
Class 10 Bayesian linear regression Explain the relationship between the least squares solution and the Bayesian solution.
Class 11 Wiener filter and estimation Explain the relationship between Wiener filter and statistical estimation method.
Class 12 EM algorithm in linear system Explain statistical parameters estimation method, where the model depends on unobserved variables.
Class 13 Linear prediction Estimate the linear prediction model for time series data.
Class 14 Spectrum estimation Estimate spectral information of time series data using the model estimated by the linear prediction.
Class 15 Kalman filter Estimates of unknown variables from series of measurements observed over time, containing statistical noise.

Textbook(s)

Kensuke Sekihara, Introduction to statistical signal processing, KYORITSU SHUPPAN CO., LTD.

Reference books, course materials, etc.

Handouts will be distributed in each class.

Assessment criteria and methods

Grading is made based on 1st exam for basis of the Statistical Signal Processing and 2 exam for the Bayesian estimation and its application.

Related courses

• ICT.M202 ： Probability and Statistics (ICT)
• ICT.S206 ： Signal and System Analysis
• ICT.S210 ： Digital Signal Processing
• ICT.S302 ： Functional Analysis and Inverse Problems
• ICT.S311 ： Machine Learning (ICT)

Prerequisites (i.e., required knowledge, skills, courses, etc.)

ICT.M202 (Probability and Statistics (ICT)), ICT.S302 (Functional Analysis and Inverse Problems) is desired. 