Probability Theory, Fall 2024

Archived

January 5, 2025

Important

This page lists archived materials that are no longer in use. Please return to the home page for the current version of the course.

Probability is the mathematics of random events. In the context of modern statistics, probability theory provides a framework for studying the properties of samples, estimators, and inferences (the subjects of STAT 426 and STAT 427). This course will cover the axiomatic formulation of probability and formalize familiar concepts, including basic probability rules, random variables, distributions, and expectations. The course will also introduce concepts that play central roles in statistics, such as joint distributions, transformations, and conditional expectations.

Read more in the [course syllabus].

Instructor: Trevor Ruiz (he/him/his) [email] [website]

Learning assistant: Edy Reynolds [email]

Class meetings:

Office hours (OH) and learning assistant hours (LAH):

For office hours, drop ins are welcome (25-236) but availability is not guaranteed without an appointment. For LA hours, availability is drop-in only on a first come, first served basis.

Week 1 (9/23/24)

Monday: sets and set operations [notes]

  • [reading] sections 1.1, 1.2, 1.2.1
  • [assignment] exercises 1.2.1, 1.2.2, 1.2.6 [solutions]
  • [optional] exercises 1.2.5, 1.2.7

Wednesday: probability axioms and properties [notes]

  • [reading] section 1.3
  • [assignment] exercises 1.3.6, 1.3.7, 1.3.21, 1.3.22 [solutions]
  • [optional] exercises 1.3.3, 1.3.5

Week 2 (9/30/24)

Monday: counting rules [notes]

  • [reading] section 1.3.1
  • [assignment] exercises 1.3.10, 1.3.18, 1.3.19 [solutions]
  • [optional] exercises 1.3.14, 1.3.15, 1.3.16

Wednesday: the matching problem [notes]

  • [reading] section 1.3.2
  • [assignment] exercises 1.3.11, 1.3.14 [solutions]

Week 3 (10/7/24)

Monday: Quiz 1 [clean copy]

  • no reading or assignment

Wednesday: conditional probability; Bayes’ theorem [notes]

  • [reading] section 1.4
  • [assignment] exercises 1.4.2, 1.4.6, 1.4.8, 1.4.34 [solutions]
  • [optional] exercises 1.4.4, 1.4.26

Week 4 (10/14/24)

Monday: the Monte Hall problem; independence [notes] [R script: sensitivity and specificity]

  • [reading] section 1.4.1
  • [assignment] exercises 1.4.11, 1.4.21, 1.4.31 [solutions]
  • [optional] exercises 1.4.12, 1.4.19, 1.4.23, 1.4.26

Wednesday: the Gambler’s ruin problem; random variables [notes] [R script: gambler’s ruin simulations]

  • [reading] section 1.5 through remark 1.5.1 (p. 39)
  • [assignment] exercises 1.4.13, 1.4.18, 1.4.22, 1.4.32 [solutions]

Week 5 (10/21/24)

Monday: Quiz 2 [clean copy]

  • no reading or assignment

Wednesday: distribution functions; discrete random variables and transformations [notes]

  • [reading] remainder of section 1.5, 1.6, 1.6.1
  • [assignment] exercises 1.5.4, 1.5.10, 1.6.4, 1.6.7, 1.6.9, 1.6.10 [solutions]
  • [optional] exercises 1.5.5, 1.5.6, 1.6.8

Week 6 (10/28/24)

Monday: continuous random variables and transformations [notes]

  • [reading] section 1.7, 1.7.2
  • [assignment] exercises 1.7.6, 1.7.12, 1.7.14, 1.7.23 [solutions]
  • [optional] exercises 1.7.8, 1.7.24, 1.7.25

Wednesday: expectations [notes]

  • [reading] sections 1.8, 1.9
  • [assignment] exercises 1.8.2, 1.8.4, 1.9.3, 1.9.4, 1.9.27 [solutions]
  • [optional] exercises 1.8.6, 1.8.9, 1.9.5, 1.9.8, 1.9.20

Week 7 (11/4/24)

Note: daylight savings time ends Sunday 11/3/24

Monday: Quiz 3 [clean copy]

  • no reading or assignment

Wednesday: the standard normal distribution; probability inequalities [notes]

  • [reading] section 1.10
  • [assignment] exercises 1.10.1, 1.10.4, 3.4.1, 3.4.11(a) [solutions]
  • [optional] exercises 1.10.2, 1.10.3

Week 8 (11/12/24)

Note: Veteran’s day observed 11/11/24

Monday: no class meeting (Veteran’s day)

Wednesday: bivariate distributions and transformations [notes]

  • [reading] sections 2.1, 2.1.1, 2.1.2, 2.2
  • [assignment] exercises 2.1.7, 2.1.10, 2.2.2, 2.1.11 [solutions]
  • [optional] exercises 2.1.1, 2.1.8, 2.2.1

Week 9 (11/18/24)

Monday: conditional distributions [notes]

  • [reading] section 2.3
  • [assignment] exercises 2.2.3, 2.2.5, 2.3.1, 2.3.3(a) [solutions]
  • [optional] exercises 2.2.4, 2.2.6, 2.2.7 2.3.8, 2.3.10

Wednesday: Quiz 4 [clean copy]

  • no reading or assignment

Week 10 (12/2/24)

Monday: independence, covariance, and correlation [notes]

  • [reading] sections 2.4, 2.5
  • [assignment] exercises 2.4.1, 2.4.11, 2.5.2, 2.5.3 [solutions]
  • [optional] exercises 2.4.7, 2.4.8, 2.4.10, 2.5.4, 2.5.7, 2.5.11

Wednesday: interpreting correlation; random samples [notes]

  • [reading] section 2.8
  • no assignment (besides studying!)

Final exam (12/7/24)

[solutions]