Learning Outcome Statement
Explain multicollinearity and how it affects regression analysis.
On the exam, the vignette gives you the regression specification, sample frequency, coefficient and standard-error evidence, and one or more auxiliary-regression R-squared values. You may need to calculate the variance inflation factor, diagnose multicollinearity, interpret both statistical and economic conclusions, and justify a correction in an item-set or MCQ format.
Multicollinearity means that independent variables carry overlapping information. Imagine a regression explaining a fund's monthly excess return with several independent variables. Pick one and call it $X_i$ when you need to examine it. If the remaining independent variables move with $X_i$, the regression has trouble separating their individual contributions. The overall fit can still look good while one coefficient becomes unstable or statistically weak.
| Diagnostic | Evidence | Signal |
|---|---|---|
| Pairwise correlation | A pair of independent variables | Pairwise screen |
| Auxiliary regression | $X_i$ on remaining variables | Joint overlap |
| Auxiliary $R_i^2$ | R-squared from that regression | Explained share |
| VIF for $X_i$ | Auxiliary $R_i^2$ | Variance inflation |
| Statistical significance | Coefficient, standard error, tail | Evidence against null |
| Economic significance | Coefficient and exposure | Practical importance |
Pairwise correlation is a screening device, not the full check for joint overlap. VIF uses the auxiliary regression of one independent variable on the other independent variables, so it can catch overlap that pairwise checks miss. Statistical significance tells you how much evidence the sample gives against a null, while economic significance asks whether the effect matters to the investment decision. The evidence comes from monthly observations, with one period equal to one month, and the inputs are not annualized.
To turn the overlap into a diagnostic, use the variance inflation factor for $X_i$, written as $\mathrm{VIF}_i$. It is dimensionless. The auxiliary-regression R-squared is written as $R_i^2$, and the auxiliary regression includes an intercept. Use this calculation.
$$ \mathrm{VIF}_i = \frac{1}{1 - R_i^2} $$
As $R_i^2$ rises, the other variables explain more of $X_i$. The unexplained share, $1-R_i^2$, shrinks, so its reciprocal rises. A high VIF means that less independent variation remains for estimating the coefficient. Standard errors usually rise and $t$-statistics usually fall, but multicollinearity does not necessarily bias ordinary least squares coefficient estimates.
Picture $X_i$ sharing information with the other independent variables. The original regression uses all variables to explain the fund's excess return. The auxiliary regression asks how much of $X_i$ the other variables already explain.
When the case supplies the auxiliary regression, follow this sequence.
Before you calculate, keep the two regressions straight. The original model explains the fund's return, while the auxiliary model explains one independent variable using the others. Its R-squared measures how much of that variable is predictable from its peers. The unexplained share is the part that remains available to identify its separate contribution. Use that share in the denominator before interpreting the result.
Loading diagram…
Run the diagnostic before changing the model. The exam's reference level is a guide, not an automatic deletion rule. Remove a variable or combine variables only when they carry redundant economic information and your theory supports the choice. Deleting a meaningful variable can damage the specification, so a weak $t$-statistic alone is not enough. Read the sequence as a calculation aid: it identifies the selected variable, specifies the auxiliary regression, and connects the resulting VIF to a decision grounded in theory. A large diagnostic flags imprecision; it does not decide the model for you.
Worked example
You are handed the case values below for a factor regression of a fund's monthly excess return. One period is one month, and the inputs are not annualized. The case gives the sample size, number of independent variables, estimated size coefficient, standard error, and an auxiliary regression of the size variable on the other factors. The exam asks whether multicollinearity is present and whether the size coefficient is statistically significant.
| Input | Value |
|---|---|
| Sample | 120 monthly sample observations |
| Independent variables | 3 explanatory variables |
| Selected auxiliary $R_i^2$ | 0.8 dimensionless R-squared |
| Size coefficient $\hat{\beta}_{\mathrm{size}}$ | 0.12 percentage points of monthly excess return per one-unit factor exposure |
| Standard error | 0.1 percentage points of monthly excess return per one-unit factor exposure |
| Hypothesis | $H_0$ has $\beta_{\mathrm{size}}=0$ versus $H_1$ has $\beta_{\mathrm{size}}\neq 0$ |
| Tail and significance | Two-tailed, $\alpha=0.05$ |
| VIF reference | 5 heuristic reference |
The line gives you a visual check on the denominator. Every plotted value is repeated in the comparison table below, so you can see how VIF responds as the selected variable becomes more predictable from the other variables. As auxiliary R-squared rises, the unexplained share falls and VIF rises. Track that inverse relationship before using the case's selected value: the curve is a quick check on direction, while the table makes each calculation easy to compare.
Loading diagram…
Read the curve from left to right: greater explanatory power in the auxiliary regression corresponds to a larger VIF. The value at 0.80 reaches the stated heuristic reference, and 0.90 produces still more inflation. The comparison below gives the exact pairs, so you can check the selected case value against nearby levels without treating the reference as a hard cutoff.
| Auxiliary $R_i^2$ | VIF |
|---|---|
| 0.20 | 1.25 |
| 0.50 | 2.00 |
| 0.80 | 5.00 |
| 0.90 | 10.00 |
- Use the auxiliary regression's R-squared, because VIF measures overlap among independent variables. For the size variable, $R_i^2=0.8$.
- Subtract the auxiliary R-squared from $1$ to find the unexplained share. The calculation gives $1 - 0.8 = 0.2000$.
- Invert that share to obtain the variance inflation factor. The result is $\mathrm{VIF}_{\mathrm{size}}=\frac{1}{0.2000}=5.00$.
- Define $t$ as the estimated coefficient divided by its standard error. Here $t=\frac{0.12}{0.1}=1.20$, so the two-tailed test at $\alpha=0.05$ does not support rejecting $H_0$.
For the fund investor, the positive estimate is 0.12 percentage points of monthly excess return per one-unit factor exposure. It can still matter economically even though the coefficient is not statistically significant. Because the VIF reaches the heuristic reference level of $5$, treat the estimate as imprecise and remove the variable only if its economic content is redundant.
Changed condition
Now the same case reports auxiliary $R_i^2=0.2$ for the size variable, while the coefficient and standard error stay unchanged. Predict the direction before reading the table.
| Measure | Original | Changed |
|---|---|---|
| Auxiliary $R_i^2$ | 0.8 | 0.2 |
| Unexplained share | 0.2000 | 0.8000 |
| VIF | 5.00 | 1.25 |
Lower auxiliary $R_i^2$ leaves more of the selected variable unexplained. The denominator grows, so VIF falls from 5.00 to 1.25 and the multicollinearity concern weakens. The coefficient and its $t$-statistic do not move because their inputs did not change. Before reading on, calculate the changed VIF yourself.
Common error
You may substitute the regression’s dependent-variable R-squared for the auxiliary-regression R-squared in VIF because both are called R-squared. That mistake feels right because the original regression’s fit seems relevant, and the VIF formula appears to need an R-squared. The wording that gives it away is the explicit regression of one independent variable on the remaining independent variables.
Check yourself
Practice
An analyst estimates a fund's monthly excess return with 3 independent variables using 120 monthly sample observations. For the size variable, the auxiliary regression on the other independent variables has an R-squared of 0.8. The estimated coefficient is 0.12 percentage points of monthly excess return per one-unit factor exposure, with standard error 0.1. The test is two-tailed at 0.05, and the VIF reference is 5.
Question 1
Calculate the VIF for the size variable.
Question 2
Which evidence is the direct VIF diagnostic?
Question 3
Which conclusion best describes the size coefficient?
Question 4
Which correction is most defensible when factors measure the same economic exposure?
The auxiliary R-squared changes from 0.8 to 0.2. The coefficient remains 0.12 and its standard error remains 0.1. Which outcome follows?
Revision snapshot
$$ \mathrm{VIF}_i = \frac{1}{1-R_i^2} $$
VIF is $1$ divided by $1$ minus the R-squared from the auxiliary regression. Use the regression of one independent variable on the remaining independent variables. Pairwise correlation is a screening device. Do not substitute the dependent-variable R-squared. Multicollinearity usually increases coefficient standard errors and reduces $t$-statistics without necessarily creating bias in OLS coefficient estimates. Separate statistical significance from economic significance before deciding whether to remove a variable. On the exam, calculate VIF, diagnose the precision problem, and justify a correction with theory and economic reasoning.
Unlock the full lesson and continue reading
Signup to continue reading this lesson and unlimited access questions, flashcards, AI notes, and more