Analysis of Variance or ANOVA

This is a tool to review a regression analysis and decompose the contribution of the variation in the independent X variable and the variation in the error (or residual) term in predicting the variation in the dependent Y variable.

Regression Sum of Squares (RSS) measures the amount of variation in Y that is explained by the variation in X.

Mean Sum of Squares of the Regression (MSSR) = RSS/degrees of freedom

Sum of the Squares of the Errors (SSE) measures the amount of variation in Y that is explained by the variation in the error term.

Mean Sum of Squares of the Errors (MSSE) = SSE/(n - x variables - 1)

√MSSE = SEE
Be careful not to confuse SSE with the Standard Error of the Estimate (SEE) – SEE is one standard deviation above and below the model line, while SSE is measure of the error term’s contribution to the explanation of the dependent variable.

Total Sum of Squares (TSS) indicates the total amount in variation in Y and equals RSS + SSE.

Note that mathematical relationships exist among R2yx, RSS, SSE, and TSS, enabling the analyst to derive one value, if given values for the others. Knowing these relationships can save you time on the exam and greatly simplify a problem that appears complex.

Unlock Premium Content

Upgrade your account to access the full article, downloads, and exercises.

You'll get access to:

Access complete tutorials and examples
Download source code and resources
Follow along with practical exercises
Get in-depth explanations

Learn

Resources

Analysis of Variance or ANOVA

Unlock Premium Content

You'll get access to:

Coefficient of Determination (R-Squared)

Multiple Regression Analysis

Topics