Welcome to STAT 88 Probability and Mathematical Statistics in Data Science
In this connector course we will state precisely and prove results discovered in DS8 through working with data. Topics include: total variation distance between discrete distributions; the mean, standard deviation, and tail bounds; correlation, and the derivation of the regression equation; probabilities, random variables, and the Central Limit Theorem; probabilistic models; symmetries in random permutations; prior and posterior distributions, and Bayes’ rule.
This course is an example of a “technical depth” connector, rather than an “application” connector. It takes the concepts that are revealed through working with data in the main course and develops the statistical or probabilistic basis for them. For example, students in the Foundations course will discover that “for almost all lists of numbers, an overwhelming majority of the entries are within a few standard deviations of the mean.” Students in Stat 88 will learn how to state this result formally as Chebychev’s inequality, and prove it. They will also present a lucid argument with the aid of a suitable diagram.
At the end of this connector course, students will have the mathematical knowledge currently contained in STAT 20, 21, and 25. With the combination of this connector and the main course, the students’ knowledge of theoretical statistics will exceed that in the current lower division Statistics courses. In addition, their knowledge will be grounded in working with real data using the computation-intensive techniques of modern data analysis.
The sequence of topics has been chosen to be appropriate for students with no more mathematics than one semester of calculus. It is also designed to be as synchronous as possible with the sequence of the Foundations course. However, as the main course contains much material that is purely related to computing, and much that is beyond the mathematical level expected in the Foundations course, perfect synchronicity of this connector with the main course is not possible. In some weeks, Stat 88 will delve further into material already covered in the Foundations course. In other weeks, students will get a theoretical preview in Stat 88 of material that they will encounter later in the Foundations course.