STAT 122 - Probability Theory II
Course Description
This course covers joint, marginal, and conditional distributions; independence of random variables;
distributions and expectations of functions of random variables; characterization of F, t, and
χ^2 distributions; normal approximation to discrete distributions.
Course Learning Outcomes
After the course, the learner should be able to:
- Identify and distinguish between the joint and marginal distributions;
- Evaluate joint, marginal and conditional distributions;
- Illustrate independence of several random variables through the joint distribution,
marginal distribution, expectations and moment generating functions;
- Evaluate expectations of several random variables;
- Evaluate conditional expectations;
- Obtain joint moment generating functions;
- State the probability density function of the bivariate normal distribution;
- Derive the marginal and conditional densities of the bivariate normal distribution;
- Determine the distribution of functions of several random variables using the
cumulative distribution function, the moment generating function, and the
transformation technique;
- Derive the probability density functions of F, t, and χ^2 distributions; and,
- Use the normal distribution to approximate the Poisson and Binomial distributions;
Course Outline
UNIT 1. Joint and Marginal Distributions
- Joint Distributions
- Definition of a Joint Distribution Function
- Properties of Joint Distribution Functions
- Classification of Joint Distribution Functions
- Marginal Distributions
- Discrete Case
- (Absolutely) Continuous Case
UNIT 2. Conditional Distributions and Stochastic Independence
- Conditional Distributions
- Discrete Case
- (Absolutely) Continuous Case
- Independence of Random Variables
UNIT 3. Expectations of Several Random Variables
- Expectations of Functions of Several Random Variables
- Definition
- Properties of Expectation
- Some Special Expectations
- Inequalities
- Conditional Expectation
- Definition
- Expectation by Conditioning
- Joint Moment Generating Functions and Moments
- Definition
- Generation of Moments
- Some Important Results
- Bivariate Normal Distribution
- Density Function
- Moment Generating Function and Moments
- Marginal and Conditional Densities
UNIT 4. Distribution of Functions of Random Variables
- Distribution of a Function of a Single Variable
- Discrete Case
- (Absolutely) Continuous Case
- Distribution of a Function of Several Random Variables
- CDF Technique
- MGF Technique
- Transformation Technique
UNIT 5. Sampling and Sampling Distributions
- Sampling
- Populations and Sample
- Statistics and Sample Moments
- Sample Mean
- Sample Mean and Sample Variance
- Law of Large Numbers
- Central Limit Theorem
- Sampling from the Normal Distribution
- Sampling Distribution of the Mean when Sampling from a Normal Population
- The Chi-square Distribution
- The F-Distribution
- Student's t-Distribution
- Order Statistics
- Definition
- Distribution of the Minimum Order Statistic
- Distribution of the Maximum Order Statistic
UNIT 6.Normal Approximation to Discrete Distributions
- Poisson by Normal
- De Moivre-Laplace Limit Theorem (Binomial by Normal)