Probability and Statistics
Full course description
Many real-life situations involve uncertainty and give rise to problems in the fields of probability theory or statistics. In this course, the focus will be on the deep understanding of tools which are necessary to analyse such situations. Firstly, we will address (or refresh) basics of probability theory and the underlying combinatorial principles, because it is impossible to properly understand statistical concepts without understanding probability and its mathematical foundations. Subsequently, we will focus on (both discrete and continuous) random variables, concepts of expectation, mean, variance and independence, proceeding to probability distributions (e.g. discrete uniform, binomial, multinomial, hypergeometric, geometric, Poisson, continuous uniform, normal, gamma, exponential). Here we will learn for what problems these distributions are useful and under which assumptions they can/should be applied, stressing also common misconceptions when trying to apply certain concept blindly (which unfortunately happens very often among applied scientists). We will extend our scope to multi- dimensional random variables and joint, conditional, and marginal probability distributions. We will also discuss random sampling, sample distributions of means and variances, and the central limit theorem, again focusing on common misconceptions related to these topics. Then we address statistical estimation (point estimation and interval estimation; confidence intervals). Finally, we will discuss various hypothesis tests, goodness-of-fit tests and tests for independence and homogeneity. In their presentation/report, students will focus on a selected statistical topic and how this can be applied in practice, using scientific articles in applied probability/statistics as their study source.
Course objectives
- To have deep understanding of fundamental concepts in probability and statistics, including how these concepts are derived, why they are useful, what assumptions you have to pose when applying them, etc.;
- To be familiar with the most frequently used probability distributions/densities and statistical procedures (statistical estimation and hypothesis tests), here again with focus on the deep understanding as opposed to approaching these concepts as a “black box” or a “recipe”;
- To develop a critical thinking when deciding whether certain statistical procedure is the most suitable for a certain problem, as opposed to blindly applying a pre-specified procedure;
- To be able to read and summarize scientific articles in applied probability/statistics.
Prerequisites
- None
Co-requisites
- None
Recommended reading
- Book: Walpole, Myers, Myers & Ye: Probability & Statistics for Engineers & Scientists. Any edition (pdf format will be provided);
- Lecture notes and selected scientific articles (will be provided via Canvas).