On this page
What this lesson covers
Simple linear regression estimates a straight-line relationship between a dependent variable and one independent variable by minimizing the sum of squared residuals.
The lesson estimates the slope and intercept using covariance, variance and sample means. It distinguishes errors from residuals, interprets indicator variables and explains why regression association does not establish causation.
How do you estimate the regression slope and intercept?
Estimate the slope as covariance of X and Y divided by variance of X, then calculate the intercept as mean Y minus slope times mean X.
Estimated slope = covariance(X, Y) / variance(X) = sum[(Y − mean Y)(X − mean X)] / sum[(X − mean X)²]
- Independent and dependent variables
- Sample means
Estimated intercept = mean Y − estimated slope × mean X
- Estimated intercept
- Estimated slope
For example, in the six-company sample, growth is measured in percentage points, mean growth is 8, mean P/E is 20, the sum of cross-products is 168 and the sum of squared growth deviations is 112. The slope is 168 / 112 = 1.5 and the intercept is 20 − 1.5 × 8 = 8, giving predicted P/E = 8 + 1.5 × growth.
Common mistakes
- Dividing covariance by the dependent variable’s variance does not give the regression slope.
- Interpreting a regression association as a causal effect claims more than regression establishes.
- Confusing residuals with errors mixes deviations from the estimated line with deviations from the true line.
Try a practice question
Choose an answer, then check it to read the explanation for every option.
Continue studying in Quizara
In Quizara the lesson comes with more practice questions on the topic, explanations for every option and an AI tutor for your follow-up questions.
Written by the Quizara Editorial Team under our editorial standards.