Learn · updated 2026-10-28
Regression Analysis: How One Variable Drives Another
Regression analysis fits a line (or surface) through your data to estimate how much an output changes for each unit change in an input, and how much of its variation that input explains.
In improvement work, regression turns "hotter seems harder" into a number you can set: how much the output moves for each unit of the input, and how sure you can be. It is the tool for the Analyze phase once you suspect a cause.
Liney = a + b·xSlope bΣ(x − x̄)(y − ȳ) ÷ Σ(x − x̄)²Intercept aȳ − b·x̄R²share of the variation in y the line explains
Worked Example
Ten parts cured at temperatures from 150 to 195 °C, hardness measured on each (an illustrative example).
| Result | Value | What it says |
|---|---|---|
| Slope b | 0.2805 | Each extra °C adds about 0.28 hardness units |
| Intercept a | 10.16 | The line's value at 0 °C: not meaningful here, far outside the data |
| R² | 0.995 | The line explains 99.5% of the variation in hardness |
| p-value of the slope | < 0.0001 | Very unlikely to be chance alone |
| S (residual σ) | 0.313 | Typical scatter of a part around the line |
So to reach hardness 60 you need about (60 − 10.16) ÷ 0.2805 = 177.7 °C, and individual parts will land within about ±0.76 hardness units of 60 (the 95% prediction interval there).
Before You Trust the Line
- Look at the residuals. Plot each part's distance from the line against x and in time order. A curve or a funnel means a straight line is the wrong model.
- Don't extrapolate. The data run from 150 to 195 °C; the line says nothing about 220 °C.
- Correlation is not cause. If temperature was raised on the same day the resin lot changed, the regression can't tell them apart. A designed experiment can.
Sources
- NIST/SEMATECH e-Handbook, §4.1.4.1 Linear Least Squares Regression
- D. C. Montgomery, E. A. Peck and G. G. Vining (2012), Introduction to Linear Regression Analysis, 5th edition, Wiley
The LimitLine Newsletter
About one email a month: new guides, tool updates and one practical SPC tip. Unsubscribe in one click.