Program Overview

Program Overview

The Probability and Random Variables program is a comprehensive course that covers the fundamental concepts of probability theory and random variables.

Course Description

The course provides an axiomatic definition of probability spaces, combinatorial methods, conditional probability, and product spaces. It also covers random variables, distribution and density functions, multivariate distribution, conditional distributions and densities, and independent random variables. Additionally, the course explores functions of random variables, expected value, moments, and characteristic functions.

Topic Outline

The course is divided into 30 topics, each covering a specific aspect of probability and random variables. The topics include:

• Introduction to probability theory
• Review of set theory
• Probability spaces
• Axioms and properties of probability
• Discrete and continuous probability laws
• Conditional probability
• Total probability theorem
• Bayes's rule
• Independence
• Conditional independence
• Independent trials
• Counting
• Discrete random variables
• Expectation and variance
• Properties of expectation and variance
• Joint PMFs
• Conditional PMFs
• Conditioning one random variable on another
• Conditional expectation
• Iterated expectation
• Independence of a random variable from an event
• Independence of random variables
• Continuous random variables
• Expectation and the cumulative distribution function
• The Gaussian CDF
• Conditional PDFs
• Joint PDFs
• Conditioning one random variable on another
• Independence, continuous Bayes's rule, and derived distributions
• Functions of two random variables
• Correlation and covariance
• Applications of covariance
• Transforms (moment generating functions)
• Markov and Chebychev inequalities
• Convergence in probability
• The weak law of large numbers
• The central limit theorem
• The Bernoulli process
• The Poisson process

Course Materials

The course materials include lecture notes, video files, and other resources that support the learning objectives of the program.

Instructor

The instructor for the Probability and Random Variables program is Elif Uysal.

Additional Information

The program was added on 21 February 2011, and the course materials are licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License.