Your browser is out of date

This browser version is too old for Quizara to display the page correctly. Update to the latest version and refresh to continue.

Simple Linear Regression: Coefficient Estimation

Updated · 2027 Level I · Quantitative Methods · Module 10 · Lesson 1 · 10 min lesson

On this page

What this lesson covers

Simple linear regression estimates a straight-line relationship between a dependent variable and one independent variable by minimizing the sum of squared residuals.

The lesson estimates the slope and intercept using covariance, variance and sample means. It distinguishes errors from residuals, interprets indicator variables and explains why regression association does not establish causation.

How do you estimate the regression slope and intercept?

Estimate the slope as covariance of X and Y divided by variance of X, then calculate the intercept as mean Y minus slope times mean X.

Estimated slope = covariance(X, Y) / variance(X) = sum[(Y − mean Y)(X − mean X)] / sum[(X − mean X)²]

Independent and dependent variables
Sample means

Estimated intercept = mean Y − estimated slope × mean X

Estimated intercept
Estimated slope

For example, in the six-company sample, growth is measured in percentage points, mean growth is 8, mean P/E is 20, the sum of cross-products is 168 and the sum of squared growth deviations is 112. The slope is 168 / 112 = 1.5 and the intercept is 20 − 1.5 × 8 = 8, giving predicted P/E = 8 + 1.5 × growth.

Review Module 10 formulas in Quizara →

Common mistakes

  • Dividing covariance by the dependent variable’s variance does not give the regression slope.
  • Interpreting a regression association as a causal effect claims more than regression establishes.
  • Confusing residuals with errors mixes deviations from the estimated line with deviations from the true line.

Try a practice question

Choose an answer, then check it to read the explanation for every option.

Practice question

In a sample, the covariance of XX and YY is 5.6 and the variance of XX is 4.0. When YY is regressed on XX, the estimated slope coefficient is closest to:

Continue studying in Quizara

In Quizara the lesson comes with more practice questions on the topic, explanations for every option and an AI tutor for your follow-up questions.

Written by the Quizara Editorial Team under our editorial standards.