STAT 129 - Regression and Correlation Analysis
Course Description
Linear regression model; model selection; regression diagnostics; use of dummy variables; remedial measures.
Course Learning Outcomes
After completion of the course, the student should be able to:
- Develop linear regression models
- Perform inferences in regression analysis
- Assess the aptness of the models
- Check and test model assumptions
- Perform remedial measures to improve model fit
- Explain and interpret final models appropriately
Course Outline
UNIT 1. Introduction
- Regression Models
- Uses of Regression Analysis
- Applications of Regression Analysis
- Data for Regression Analysis
- Steps in Regression Analysis
UNIT 2. Simple Linear Regression
- Simple Linear Regression Model with Distribution of Error Terms Unspecified
- Estimation of Regression Function
- Estimation of Error Terms Variance σ²
- Normal Error Regression Model
UNIT 3. Inferences in Regression Analysis
- Inferences Concerning β0 and β1
- Interval Estimation of E(Yh)
- Prediction of New Observation
- Confidence Band for Regression Line
- ANOVA Approach to Regression Analysis
- Coefficient of Determination and Correlation
UNIT 4. Regression Diagnostics and Remedial Measures
- Diagnostics for Predictor Variable
- Residuals and Residual Analysis
- F Test for Lack of Fit
- Remedial Measures and Transformations
- Exploration of Shapes of Regression Function
UNIT 5. Simultaneous Inferences and Other Topics
- Joint Estimation of β0 and β1
- Simultaneous Estimation of Mean Responses
- Simultaneous Prediction Intervals for New Observations
- Other Topics
- Regression through the Origin
- Effects of Measurement Errors
- Inverse Predictions
- Choice of X Levels
Unit 6. Matrix Approach to Simple Linear Regression Analysis
- Matrices and their Properties
- Simple Linear Regression Model in Matrix Terms
- Least Squares Estimation of Regression Parameters
- ANOVA Results and Inferences in Regression Analysis
- Estimation of Mean Response and Prediction of New Observations
Unit 7. Multiple Linear Regression
- General Linear Regression Model in Matrix Terms
- Inferences about Regression Parameters
- Extra Sum of Squares and Its Uses
- Diagnostics and Remedial Measures
- Multicollinearity and Its Effects
Unit 8. Regression Models for Quantitative and Qualitative Predictors
- Polynomial Regression Models
- Interaction Regression Models
- Qualitative Predictors
- Modelling Interactions between Quantitative and Qualitative Predictors
- Comparison of Two or More Regression Functions
Unit 9. Model Building, Diagnostics, and Remedial Measures for MLR Models
- The Model-Building Strategy
- Selection of Independent Variables
- Automatic Search Procedures for Model Selection
- Model Validation