{"id":1295,"date":"2019-08-19T10:12:00","date_gmt":"2019-08-19T10:12:00","guid":{"rendered":"https:\/\/analystprep.com\/study-notes\/?p=1295"},"modified":"2026-05-04T18:39:53","modified_gmt":"2026-05-04T18:39:53","slug":"linear-regression-with-multiple-regressors","status":"publish","type":"post","link":"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/","title":{"rendered":"Regression with Multiple Explanatory Variables"},"content":{"rendered":"<p><iframe loading=\"lazy\" src=\"\/\/www.youtube.com\/embed\/XWaj2sqrZG4\" width=\"611\" height=\"343\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p><strong>After completing this reading, you should be able to:<\/strong><\/p>\n<ul>\n<li>Distinguish between the relative assumptions of single and multiple regression.<\/li>\n<li>Interpret regression coefficients in multiple regression.<\/li>\n<li>Interpret goodness of fit measures for single and multiple regressions, including R<sup>2<\/sup> and adjusted R<sup>2<\/sup>.<\/li>\n<li>Construct, apply, and interpret joint hypothesis tests and confidence intervals for multiple coefficients in regression.<\/li>\n<\/ul>\n<p>Unlike linear regression, <strong>multiple regression <\/strong>simultaneously considers the influence of multiple explanatory variables on a response variable Y. In other words, it permits us to evaluate the effect of more than one independent variable on a given dependent variable.<\/p>\n<p>The form of the multiple regression model (equation) is given by:<\/p>\n<p>$$Y_i\u00a0 = \u03b2_0\u00a0 + \u03b2_1 X_1i\u00a0 + \u03b2_2 X_2i\u00a0 + \u2026 + \u03b2_k X_ki\u00a0 + \u03b5_i\u00a0 \\quad \u2200i = 1, 2, \u2026 n$$<\/p>\n<p>Intuitively, the multiple regression model has <em>k<\/em> slope coefficients and <em>k+1<\/em> regression coefficients. Normally, statistical software (such as Excel and R) are used to estimate the multiple regression model.<\/p>\n<h2>Interpreting the Multiple Regression Coefficients<\/h2>\n<p>The slope coefficients \\({\\beta}_k\\)<sub>\u00a0\u00a0<\/sub>computes the level of variation of the dependent variable Y when the independent variable \\(X_j\\)<sub>\u00a0\u00a0<\/sub>changes by one unit while holding other independent variables constant. The interpretation of the multiple regression coefficients is quite different compared to linear regression with one independent variable. The effect of one variable is explored while keeping other independent variables constant.<\/p>\n<p>For instance, a linear regression model with one independent variable could be estimated as \\(\\hat{Y}=0.6+0.85X_1\\). In this case, the slope coefficient is 0.85, which implies that a 1 unit increase in X<sub>1 <\/sub>results in 0.85 units increases independent variable Y.<\/p>\n<p>Now, assume that we had the second independent variable to the regression so that the regression equation is \\(\\hat{Y}=0.6+0.85X_1+0.65X_2\\). A unit increase in X<sub>1 <\/sub>will not result in a 0.85 unit increase in Y unless X<sub>1 <\/sub>and X<sub>2 <\/sub>are uncorrelated. Therefore, we will interpret 0.85 as one unit of X<sub>1 <\/sub>leads to 0.85 units increase in the dependent variable Y, while keeping X\u00ad<sub>2<\/sub> constant.<\/p>\n<div style=\"background:#f3f4f6; padding:16px 14px; border-radius:12px; margin:20px 0; text-align:center;\">\n  <a href=\"https:\/\/analystprep.com\/free-trial\/\" target=\"_blank\" rel=\"noopener noreferrer\"\n     style=\"display:inline-flex; align-items:center; justify-content:center; padding:12px 18px; border:2px solid #1d4ed8; border-radius:999px; color:#1d4ed8; text-decoration:none; font-weight:600; font-size:16px; line-height:1; background:#ffffff; white-space:nowrap;\"><br \/>\n    Strengthen your FRM multiple regression modeling skills<br \/>\n  <\/a>\n<\/div>\n<h2>OLS Estimators for the Multiple Regression Parameters<\/h2>\n<p>Although the multiples regression parameters can be estimated, it is challenging since it involves a huge amount of algebra and the use of matrices. However, we build a foundation of understanding using the multiple regression model with two explanatory variables.<\/p>\n<p>Consider the following multiples regression equation.<\/p>\n<p>$$Y_i \u00a0= \u03b2_0 \u00a0+ \u03b2_1 X_1i \u00a0+ \u03b2_2 X_2i+\u03b5_i$$<\/p>\n<p>The OLS estimator of <strong>\u03b2<\/strong><sub>1<\/sub> is estimated as follows:<\/p>\n<p>The first step is to regress X<sub>1 <\/sub>and X<sub>2 <\/sub>\u00a0and to get the residual of\u00a0 \\(X_{1i}\\)\u00a0 given by:<\/p>\n<p>$${\\epsilon}_{X_{1i}}=X_{1i}-{\\hat{\\alpha}}_{0}-{\\hat{\\alpha}}_{1}X_{2i}$$<\/p>\n<p>Where \\(\\hat{\u03b1} _0\\) and \\(\\hat{\u03b1} _1\\)\u00a0 are the OLS estimators of \\(X_{2i}\\).<\/p>\n<p>The next step is to regress Y on X<sub>2 <\/sub>to get the residuals of Y<sub>i,<\/sub> which is intuitively given by:<\/p>\n<p>$${\\epsilon}_{Y_i }=Y_i-{\\hat{y} _0}-{\\hat{y}} _{1} X_{2i}$$<\/p>\n<p>Where \\({\\hat{\u03b3}} _0\\) and\u00a0 \\({\\hat{\u03b3}} _1\\)\u00a0 are the OLS estimators of \\(X_{2i}\\). The final step is to regress the residual of X<sub>1 <\/sub>and Y \\( (\u03f5_{X_{1i}}\u00a0 \\text{ and } \u03f5_{Y_i }) \\)\u00a0 to get:<\/p>\n<p>$$\u03f5_{Y_i }=\\hat{\u03b2} _1 \u03f5_{X_{1i} }+\u03f5_i $$<\/p>\n<p>Note that we do not have a constant, the expected values of \\(\u03f5_{Y_i }\\)\u00a0 and \\(\u03f5_{X_i }\\) \u00a0are both 0. Moreover, the main purpose of the first and the second regression is to exclude the effect of X<sub>2 <\/sub>from both Y and X<sub>1<\/sub> by dividing the variable into the fittest value which is correlated with X<sub>2,\u00a0<\/sub>and the residual error which is uncorrelated with X<sub>2 <\/sub>and thus the two-residual obtained is uncorrelated with X<sub>2 <\/sub>\u00a0by intuition. The last step of the regression gives the regression between the components of Y and X<sub>1,<\/sub> which is uncorrelated with X<sub>2<\/sub>.<\/p>\n<p>The OLS estimator for \\(\u03b2_2\\)\u00a0 can be approximated analogously as that of \\(\u03b2_1\\)\u00a0 by exchanging X<sub>2 <\/sub>for X<sub>1<\/sub> in the process above. By repeating this process, we can estimate a k-parameter model such as:<\/p>\n<p>$$Y_i \u00a0= \u03b2_0 \u00a0+ \u03b2_1 X_{1i}\u00a0 + \u03b2_2 X_{2i}\u00a0 + \u2026 + \u03b2_k X_{ki}\u00a0 + \u03b5_i \u00a0\u2200i = 1, 2, \\dots n$$<\/p>\n<p>Most of the time, this is done using a statistical package such as Excel and R.<\/p>\n<h3>Assumptions of the Multiple Regression Model<\/h3>\n<p>Suppose that we have n observations of the dependent variable (Y) and the independent variables (X<sub>1<\/sub>, X<sub>2<\/sub>, . . . , X<sub>k<\/sub>), we need to estimate the equation:<\/p>\n<p>$$Y_i \u00a0= \u03b2_0 \u00a0+ \u03b2_1 X_{1i}\u00a0 + \u03b2_2 X_{2i}\u00a0 + \u2026 + \u03b2_k X_{ki}\u00a0 + \u03b5_i \u00a0\\quad \u2200i = 1, 2, \\dots n$$<\/p>\n<p>For us to make a valid inference from the above equation, we need to make classical normal multiple linear regression model assumptions as follows:<\/p>\n<ol>\n<li>The relationship between the dependent variable, Y, and the independent variables, X<sub>1<\/sub>, X<sub>2<\/sub>, . . . , X<sub>k<\/sub>, is linear.<\/li>\n<li>The independent variables (X<sub>1<\/sub>, X<sub>2<\/sub>, . . . , X<sub>k<\/sub>) are iid. Moreover, there is no definite linear relationship that exists between two or more of the independent variables, X<sub>1<\/sub>, X<sub>2<\/sub>, . . . , X<sub>k<\/sub>.<\/li>\n<li>The expectation of value of the error term, conditioned on the independent variables, is 0: E(\u03f5| X<sub>1<\/sub>, X<sub>2<\/sub>, . . . , X<sub>k<\/sub>) = 0<\/li>\n<li>The variance of the error term is equal for all observations. That is, \\(E(\u03f5_i^2 )=\u03c3_\u03f5^2, i=1,2,\u2026,n\\) (homoskedasticity assumption). The assumption enables us to estimate the distribution of the regression coefficients<sub>.<\/sub><\/li>\n<li>The error term \u03f5 is uncorrelated in all observations. Mathematically put,\\(E(\u03f5_i \u03f5_j )=0\u00a0 \\quad \u2200 i\u2260j\\)<\/li>\n<li>The error term \u03f5 is normally distributed. This allows us to test the hypothesis about regression analysis.<\/li>\n<li>There are no outliers so that \\(E(X_{ji}^{4} )&lt;\u221e\\) for all j=1,2\u2026.k<\/li>\n<\/ol>\n<p>The assumptions are almost the same as those of linear regression with one independent variable, only that the second assumption is tailored to ensure no linear relationships between the independent variables (multicollinearity).<\/p>\n<h2>Measures of Goodness of Fit<\/h2>\n<p>The goodness of fit of a regression is a measure using the Coefficient of determination (\\(R^2\\)) and the adjusted coefficient of determination.<\/p>\n<h3>The Coefficient of Determination (\\(R^2\\))<\/h3>\n<p>Recall that the standard error estimate gives a percentage at which we are certain of a forecast made by a regression model. However, it does not tell us how suitable is the independent variable in determining the dependent variable. The coefficient of variation corrects this shortcoming.<\/p>\n<p>The coefficient of variation measures a proportion of the total change in the dependent variable explained by the independent variable.\u00a0 We can calculate the coefficient of variation in two ways:<\/p>\n<h3>1.\u00a0\u00a0\u00a0 Squaring the Correlation Coefficient between the Dependent and Independent Variables.<\/h3>\n<p>The coefficient of variation can be computed by squaring the correlation coefficient (r) between the dependent and independent variables. That is:<\/p>\n<p>$$R^{2}=r^{2}$$<\/p>\n<p>\u00a0Recall that:<\/p>\n<p>$$r=\\frac{Cov(X,Y)}{{\\sigma}_{X}{\\sigma}_{Y}}$$<\/p>\n<p>Where<\/p>\n<p>\\(Cov(X, Y)\\)-covariance between two variables, X and Y<\/p>\n<p>\\(\u03c3_X\\)-standard deviation of X<\/p>\n<p>\\(\u03c3_Y\\)-standard deviation of Y<\/p>\n<p>However, this method only accommodates regression with one independent variable.<\/p>\n<h4>Example: Calculating the Coefficient of Determination using Correlation Coefficient<\/h4>\n<p>The correlation coefficient between the money supply growth rate (dependent, Y) and inflation rates (independent, X) is 0.7565. The standard deviation of the dependent (explained) variable is 0.050, and that of the independent variable is 0.02. Regression analysis for the ten years was conducted on this variable. We need to calculate the coefficient of determination.<\/p>\n<p><strong>Solution <\/strong><\/p>\n<p>We know that:<\/p>\n<p>$$r=\\frac{Cov(X,Y)}{{\\sigma}_{X}{\\sigma}_{Y}}=\\frac{0.0007565}{0.05\\times 0.02}=0.7565$$<\/p>\n<p>So, the coefficient of determination is given by:<\/p>\n<p>$$r^{2}=0.7565^2 =0.5723=57.23%$$<\/p>\n<p>So, in regression, the money supply growth rate explains roughly 57.23% of the variation in the inflation rate over the ten years.<\/p>\n<h3>2.\u00a0\u00a0\u00a0 Method for Regression Model with One or More Independent Variables<strong>\u00a0<\/strong><\/h3>\n<p>If the regression analysis is known, then our best estimate for any observation for the dependent variable would be the mean. Alternatively, instead of using the mean as an estimate of Y<sub>i<\/sub>, we can predict an estimate using the regression equation. The resulting solution will be denoted as:<\/p>\n<p>$$Y_i\u00a0 = \u03b2_0\u00a0 + \u03b2_1 X_1i\u00a0 + \u03b2_2 X_2i\u00a0 + \u2026 + \u03b2_k X_ki\u00a0 + \u03b5_i=\\hat{Y} _i+\\hat{\u03f5} _i$$<\/p>\n<p>So that:<\/p>\n<p>$$Y_i=\\hat{Y} _i+\\hat{\u03f5} _i$$<\/p>\n<p>Now if we subtract the mean of the dependent variable\u00a0 in the above equation and square and sum on both sides so that:<\/p>\n<p>$$\\begin{align*}\\sum_{i=1}^{n}{\\left(Y_i -\\bar{Y}\\right)^2}&amp;=\\sum_{i=1}^{n}{\\left(\\hat{Y}_i -\\bar{Y}+\\hat{\\epsilon}_i\\right)^2}\\\\&amp;=\\sum_{i=1}^{n}{\\left(\\hat{Y}_i -\\bar{Y}\\right)^2}+2\\sum_{i=1}^{n}{\\hat{\\epsilon}_{i} \\left(\\hat{Y}_i -\\bar{Y}\\right)}+\\sum_{i=1}^{n}{\\hat{\\epsilon}_{i}^2}\\end{align*}$$<\/p>\n<p>Note that:<\/p>\n<p>$$2\\sum_{i=1}^{n}{\\hat{\\epsilon}_{i} \\left(\\hat{Y}_i -\\bar{Y}\\right)}=0$$<\/p>\n<p>Since the sample correlation between \\(\\hat{Y} _i\\) and \\(\\hat{\\epsilon} _i\\)is 0. The expression, therefore, reduces to,<\/p>\n<p>$$\\sum_{i=1}^{n}{\\left(Y_i -\\bar{Y}\\right)^2}=\\sum_{i=1}^{n}{\\left(\\hat{Y}_i -\\bar{Y}\\right)^2}+\\sum_{i=1}^{n}{\\hat{\\epsilon}_{i}^2}$$<\/p>\n<p>But<\/p>\n<p>$$\\hat{\\epsilon}^{2}_{i}=\\left(Y_i -\\hat{Y}\\right)^2$$<\/p>\n<p>So, that<\/p>\n<p>$$\\sum_{i=2}^{n}{\\hat{\\epsilon}_{i}^{2}}=\\sum_{i=1}^{n}{\\left(Y_i -\\hat{Y}\\right)^2}$$<\/p>\n<p>Therefore,<\/p>\n<p>$$\\sum_{i=1}^{n}{\\left(Y_i -\\bar{Y}\\right)^2}=\\sum_{i=1}^{n}{\\left(\\hat{Y}_i -\\bar{Y}\\right)^2}+\\sum_{i=1}^{n}{\\left(Y_i -\\hat{Y}\\right)^2}$$<\/p>\n<p>If the regression analysis is useful for predicting Y<sub>i<\/sub> using the regression equation, then the error should be smaller than predicting Y<sub>i<\/sub> using the mean.<\/p>\n<p>Now let:<\/p>\n<p>Explained Sum of Squares (ESS)=\\(\\sum_{i=1}^{n} {\\left(\\hat{Y}_i -\\bar{Y}\\right)^2}\\)<\/p>\n<p>Residual Sum of Squares (RSS) \u00a0=\\(\\sum_{i=1}^{n} {\\left(Y_i -\\hat{Y}\\right)^2}\\)<\/p>\n<p>Total Sum of Squares (TSS)=\\(\\sum_{i=1}^{n} {\\left(Y_i -\\bar{Y}\\right)^2}\\)<\/p>\n<p>Then:<\/p>\n<p>\u00a0$$TSS=ESS +RSS$$<\/p>\n<p>If we divide both sides by TSS, we get:<\/p>\n<p>$$\\begin{align*}1&amp;=\\frac{ESS}{TSS}\u00a0 +\\frac{RSS}{TSS}\\\\&amp;\u21d2\\frac{ESS}{TSS}=1-\\frac{RSS}{TSS}\\end{align*}$$<\/p>\n<p>Now, recall than the coefficient of determination is the fraction of the overall change that is reflected in the regression. Denoted by R<sup>2<\/sup>, coefficient of determination is given by:<\/p>\n<p>$$R^2 =\\frac{\\text{Explained Variation}}{\\text{Total Variation}}=\\frac{ESS}{TSS}=1-\\frac{RSS}{TSS}$$<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"1434\" height=\"1151\" class=\"aligncenter size-full wp-image-6974\" style=\"max-width: 100%;\" src=\"https:\/\/analystprep.com\/study-notes\/wp-content\/uploads\/2019\/10\/page-138.jpg\" alt=\"Ordinary Least Squares\" srcset=\"https:\/\/analystprep.com\/study-notes\/wp-content\/uploads\/2019\/10\/page-138.jpg 1434w, https:\/\/analystprep.com\/study-notes\/wp-content\/uploads\/2019\/10\/page-138-300x241.jpg 300w, https:\/\/analystprep.com\/study-notes\/wp-content\/uploads\/2019\/10\/page-138-768x616.jpg 768w, https:\/\/analystprep.com\/study-notes\/wp-content\/uploads\/2019\/10\/page-138-1024x822.jpg 1024w, https:\/\/analystprep.com\/study-notes\/wp-content\/uploads\/2019\/10\/page-138-400x321.jpg 400w, https:\/\/analystprep.com\/study-notes\/wp-content\/uploads\/2019\/10\/page-138-600x482.jpg 600w\" sizes=\"auto, (max-width: 1434px) 100vw, 1434px\" \/>If a model does not explain any of the observed data, then it has an\u00a0\\(R^2\\)\u00a0 of 0 . On the other hand, if the model perfectly describes the data, then it has an \\(R^2\\) of 1. Other values are in the range of 0 and 1 and are always positive. For instance, in the above example, the \\(R^2\\)\u00a0\u00a0is approximately 1 and thus, the money supply growth rate perfectly explains the level of inflation rates in the countries.<\/p>\n<h3>Limitations of \\(R^2\\)<\/h3>\n<ol>\n<li>As the number of explanatory variables increases, the value of \\(R^2\\) always increases even if the new variable is almost completely irrelevant to the dependent variable. For instance, if a regression model with one explanatory variable is modified to have two explanatory variables, the new \\(R^2\\) is greater or equal to that of a single explanatory model. In the case where \\(\\beta = 0\\), adding a variable will not increase \\(R^2\\). In that case, the RSS will remain the same and so does \\(R^2\\).<\/li>\n<li>The Coefficient of Determination \\(R^2\\) cannot be compared in different dependent variables. For instance, we cannot compare the \\(R^2\\) for Y<sub>i\u00a0<\/sub>and lnY<sub>i <\/sub>.<\/li>\n<li>There is no standard value of \\(R^2\\) that is considered good because its values depend on the nature of the data involved.<\/li>\n<\/ol>\n<p>Considering the first limitation, we now discuss the adjusted \\(R^2\\).<\/p>\n<h2>The Adjusted R<sup>2<\/sup><\/h2>\n<p>Denoted by \u00a0\\(\\bar{R} ^2\\), the adjusted-R<sup>2<\/sup> measures the goodness of fit, which does not automatically increase if an independent variable is added to the model; that is, it is adjusted for the degrees of freedom. Note that \\(\\bar{R} ^2\\)\u00a0 is produced by statistical software. The relationship between the R<sup>2 <\/sup>and\u00a0 \u00a0\\(\\bar{R} ^2\\)\u00a0 is given by:<\/p>\n<p>$$\\bar{R}^2 =1-\\frac{\\left(\\frac{RSS}{n-k-1}\\right)}{\\left(\\frac{TSS}{n-1}\\right)}$$<\/p>\n<p>$$=1-\\left(\\frac{n-1}{n-k-1}\\right)\\left(1-R^2\\right)$$<\/p>\n<p>Where<\/p>\n<p><em>n<\/em>=number of observations<\/p>\n<p><em>k<\/em>=number of the independent variables (Slope coefficients)<\/p>\n<p>The adjusted R-squared can increase, but that happens only if the new variable improves the model more than would be expected by chance. If the added variable improves the model by less than expected by chance, then the adjusted R-squared decreases.<\/p>\n<p>When k\u2265 1, then \\(R^2&gt;\\bar{R}^2\\)\u00a0 since adding an extra new independent variable results in a decrease in \\(\\bar{R}^2\\)\u00a0 if that addition causes a small increase in \\(R^2\\). This explains the fact that \\(\\bar{R}^2\\)\u00a0 can be a negative though \\(R^2\\)\u00a0 is always nonnegative.<\/p>\n<p>A point to note is that when we decide to use \\(\\bar{R}^2\\)\u00a0 to compare the regression models, the dependent variable is defined the same way and that the sample size is the same as that of \\(R^2\\).<\/p>\n<p>The following are the factors to watch out for when guarding against applying the \\(R^2\\)\u00a0 or the \\(\\bar{R}^2\\):<\/p>\n<ul>\n<li>An added variable doesn\u2019t have to be statistically significant just because the \\(R^2\\)\u00a0 or the\u00a0 \\(\\bar{R}^2\\)\u00a0 has increased.<\/li>\n<li>It is not always true that the regressors are a true cause of the dependent variable, just because there is a high \\(R^2 \\) or \\(\\bar{R}^2\\).<\/li>\n<li>It is not necessary that there is no omitted variable bias just because we have a high R<sup>2<\/sup>\u00a0 or \\(\\bar{R}^2\\).<\/li>\n<li>It is not necessarily true that we have the most appropriate set of regressors just because we have a high \\(R^2\\)\u00a0 or \\(\\bar{R}^2\\)<\/li>\n<li>It is not necessarily true that we have an inappropriate set of regressors just because we have a low \\(R^2\\)\u00a0 or \\(\\bar{R}^2\\).<\/li>\n<\/ul>\n<p>\\(\\bar{R}^2\\) does not automatically indicate that regression is well specified due to its inclusion of a right set of variables since a high \\(\\bar{R}^2\\)\u00a0 could reflect other uncertainties in the data in the analysis. Moreover, \\(\\bar{R}^2\\)\u00a0 can be negative if the regression model produces an extremely poor fit.<\/p>\n<h2>Joint Hypothesis Test on Multiple Regression Parameters<\/h2>\n<p>Previously, we had conducted hypothesis tests on individual regression coefficients using the t-test. We need to perform a joint hypothesis test on the multiple regression coefficients using the F-test based on the F-statistic.<\/p>\n<p>In multiple regression, we cannot test the null hypothesis that all the slope coefficients are equal to 0 using the t-test. This is because an individual test on the coefficient does not accommodate the effect of interactions among the independent variables (multicollinearity).<\/p>\n<p>F-test (test of regression\u2019s generalized significance) determines whether the slope coefficients in multiple linear regression are all equal to 0. That is, the null hypothesis is stated as\\(H_0:\u03b2_1=\u03b2_2\u00a0 = &#8230; =\u03b2_K= 0\\) \u00a0against the alternative hypothesis that at least one slope coefficient is not equal to 0.<\/p>\n<p>To accurately compute the test statistic for the null hypothesis that the slope is equal to 0, we need to identify the following:<\/p>\n<p>I. The Sum of Squared Residuals (SSR) given by:<\/p>\n<p>$$\\sum_{i=1}^{n} {\\left(Y_i -\\hat{Y}_i\\right)^2}$$<\/p>\n<p>This is also called the residual sum of squares.<\/p>\n<p>II.Explained Sum of Squares (ESS) given by:<\/p>\n<p>$$\\sum_{i=1}^{n} {\\left(\\hat{Y}_i -\\bar{Y}_i\\right)^2}$$<\/p>\n<p>III. The total number of observations (<em>n<\/em>).<\/p>\n<p>III. The number of parameters to be estimated. For example, in a regression analysis with one independent variable, there are two parameters: the slope and the intercept coefficients.<\/p>\n<p>Using the above four requirements, we can determine the F-statistic. The F-statistic measures how effective the regression equation explains the changes in the dependent variable. The F-statistic is denoted by <em>F<\/em><sub>(Number of slope parameters, n-(number of parameters))<\/sub><em>. For<\/em> instance, the F-statistic for multiple regression with two slope coefficients (and one intercept coefficient) is denoted as <em>F<sub>2, n-3<\/sub><\/em>. The value <em>n-3 <\/em>represents the degrees of freedom for the F-statistic.<\/p>\n<p>The F-statistic is the ratio of the average regression sum of squares to the average amount of squared errors. The average regression sum of squares is the regression sum of squares divided by the number of slope parameters (<strong>k<\/strong>) estimated. The average sum of squared errors is the sum of squared errors divided by the number of observations (n) less a total number of parameters estimated ((<em>n <\/em>&#8211; (<em>k <\/em>+ 1)). Mathematically:<\/p>\n<p>$$F=\\frac{\\text{Average regression sum of squares}}{\\text{The average sum of squared errors}}$$<\/p>\n<p>$$=\\frac{\\frac{\\text{Explained sum of squares}}{\\text{ESS Slope parameters estimated}}}{\\frac{\\text{Sum of squared residuals (SSR)}}{n-\\text{number of parameters estimated}}}$$<\/p>\n<p>In this case, we are dealing with a multiple linear regression model with <strong>k<\/strong> independent variable whose F-statistic is given by:<\/p>\n<p>$$F=\\frac{\\left(\\frac{ESS}{k}\\right)}{\\left(\\frac{SSR}{n-(k+1)}\\right)}$$<\/p>\n<p>In regression analysis output (ANOVA part), MSR and MSE are displayed as the first and the second quantities under the MSS (mean sum of the squares) column, respectively. If the overall regression\u2019s significance is high, then the ratio will be large.<\/p>\n<p>If the independent variables do not explain any of the variations in the dependent variable, each predicted independent variable \\(\\hat{Y}_i )\\) possesses the mean value of the dependent variable \\((Y)\\). Consequently, the regression sum of squares is 0 implying the F-statistic is 0.<\/p>\n<p>So, how do we decide F-test? We reject the null hypothesis at <strong>\u03b1 <\/strong>significance level if the computed F-statistic is greater than the upper <strong>\u03b1 <\/strong>critical value of the F-distribution with the provided numerator and denominator degrees of freedom (F-test is always a one-tailed test).<\/p>\n<h4><strong>Example: Conducting F-test<\/strong><\/h4>\n<p>An analyst runs a regression of monthly value-stock returns on four independent variables over 48 months.<\/p>\n<p>The total sum of squares for the regression is 360, and the sum of squared errors is 120.<\/p>\n<p>Test the null hypothesis at a 5% significance level (95% confidence) that all the four independent variables are equal to zero.<\/p>\n<h4>Solution<\/h4>\n<p><em>$$H_0:\u03b2_1=0,\u03b2_2=0,\u2026,\u03b2_4=0$$<\/em><\/p>\n<p>Versus<\/p>\n<p>$$ H_1:\u03b2_j\u22600 \\text{(at least one j is not equal to zero, j=1,2\u2026 k )} $$<\/p>\n<p>ESS = TSS \u2013 SSR = 360 \u2013 120 = 240<\/p>\n<p>The calculated test statistic:<\/p>\n<p>$$F=\\frac{\\left(\\frac{ESS}{k}\\right)}{\\left(\\frac{SSR}{n-(k+1)}\\right)}=\\frac{\\frac{240}{4}}{\\frac{120}{43}}=21.5$$<\/p>\n<p>\\(F_{4,43}^3\\) is approximately 2.59 at a 5% significance level.<\/p>\n<p>Decision: Reject H<sub>0<\/sub>.<\/p>\n<p>Conclusion:\u00a0<strong>at\u00a0least one\u00a0<\/strong>of the 4 independent variables is significantly different than zero.<\/p>\n<h4>Example: Calculating F-statistic and Conducting the F-test<\/h4>\n<p>An investment analyst wants to determine whether the natural log of the ratio of bid-offer spread to the price of a stock can be explained by the natural log of the number of market participants and the amount of market capitalization. He assumes a 5% significance level. The following is the result of the regression analysis.<\/p>\n<p>$$\\begin{array}{l|c|c|c} &amp; \\textbf{Coefficient} &amp; \\textbf{Standard Error} &amp; \\textbf{t-Statistic} \\\\ \\hline \\text{Intercept } &amp; 1.6959 &amp; 0.2375 &amp; 7.0206 \\\\ \\text{Number of market participants} &amp; -1.6168 &amp; 0.0708 &amp; -22.8361 \\\\ \\text{Amount of Capitalization} &amp; -0.4709 &amp; 0.0205 &amp; -22.9707 \\end{array}$$<\/p>\n<p>$$\\begin{array}{l|c|c|c} \\textbf{ANOVA} &amp; \\textbf{df} &amp; \\textbf{SS} &amp; \\textbf{MSS} &amp; \\textbf{F} &amp; \\textbf{Significance F} \\\\ \\hline \\text{Regression} &amp; 2 &amp; 3,730.1534 &amp; 1,865.0767 &amp; 2,217.95 &amp; 0.00 \\\\ \\text{Residual} &amp; 2,797 &amp; 2,351.9973 &amp; 0.8409 &amp; &amp; \\\\ \\text{Total} &amp; 2,799 &amp; 5,801.2051 &amp; &amp; &amp; \\end{array}$$<\/p>\n<p>$$ \\begin{array}{lc} \\text{Residual standard error} &amp; 0.9180 \\\\ \\text{Multiple R-squared}\u00a0 \u00a0 \u00a0 &amp; 0.6418 \\\\ \\text{Observations}&amp; 2,800 \\end{array} $$<\/p>\n<p>We are concerned with the ANOVA (Analysis of variance) results. We need to conduct F-test to determine the significance of regression analysis.<\/p>\n<p><strong>Solution<\/strong><\/p>\n<p>So, the hypothesis is stated as:<\/p>\n<p>$$H_0 :\\hat{\\beta}_1 =\\hat{\\beta}_2=0$$<\/p>\n<p>vs<\/p>\n<p>$$H_1: \\text{At\u00a0least\u00a01}\u00a0 \\hat{\u03b2} _j\u22600, \u2200 j=1,2$$<\/p>\n<p>There are two slope coefficients, k=2 (coefficients on the natural log of the number of market participants and the amount of market capitalization), which is degrees of freedom for the numerator of the F-statistic formula. For the denominator, the degrees of freedom are n- (k + 1) =2800-3= 2,797.<\/p>\n<p>The sum of the squared errors is 2,351.9973, while the regression sum of squares is 3,730.1534. Therefore, the F-statistic is:<\/p>\n<p>$$F_{2,2797}=\\frac{\\left(\\frac{ESS}{k}\\right)}{\\left(\\frac{SSR}{n-(k+1)}\\right)}=\\frac{\\frac{3730.1534}{2}}{\\frac{2351.9973}{2797}}=2217.9530$$<\/p>\n<p>Since we are working at a 5% (0.05) significance level, we look at the F-distribution table on the second column which displays the F-distributions with degrees of freedom in the numerator of the F-statistic formula as seen below:<\/p>\n<p>$$\\textbf{F Distribution: Critical Values of F (5% significance level)}$$<\/p>\n<p>$$\\begin{array}{l|llllllllll}<br \/>\n&amp; \\textbf{1} &amp; \\textbf{2} &amp; \\textbf{3} &amp; \\textbf{4} &amp; \\textbf{5} &amp; \\textbf{6} &amp; \\textbf{7} &amp; \\textbf{8} &amp; \\textbf{9} &amp; \\textbf{10} \\\\ \\hline<br \/>\n\\textbf{10} &amp; 4.96 &amp; 4.10 &amp; 3.71 &amp; 3.48 &amp; 3.33 &amp; 3.22 &amp; 3.14 &amp; 3.07 &amp; 3.02 &amp; 2.98 \\\\<br \/>\n\\textbf{11} &amp; 4.84 &amp; 3.98 &amp; 3.59 &amp; 3.36 &amp; 3.20 &amp; 3.09 &amp; 3.01 &amp; 2.95 &amp; 2.90 &amp; 2.85 \\\\<br \/>\n\\textbf{12} &amp; 4.75 &amp; 3.89 &amp; 3.49 &amp; 3.26 &amp; 3.11 &amp; 3.00 &amp; 2.91 &amp; 2.85 &amp; 2.80 &amp; 2.75 \\\\<br \/>\n\\textbf{13} &amp; 4.67 &amp; 3.81 &amp; 3.41 &amp; 3.18 &amp; 3.03 &amp; 2.92 &amp; 2.83 &amp; 2.77 &amp; 2.71 &amp; 2.67 \\\\<br \/>\n\\textbf{14} &amp; 4.60 &amp; 3.74 &amp; 3.34 &amp; 3.11 &amp; 2.96 &amp; 2.85 &amp; 2.76 &amp; 2.70 &amp; 2.65 &amp; 2.60 \\\\<br \/>\n\\textbf{15} &amp; 4.54 &amp; 3.68 &amp; 3.29 &amp; 3.06 &amp; 2.90 &amp; 2.79 &amp; 2.71 &amp; 2.64 &amp; 2.59 &amp; 2.54 \\\\<br \/>\n\\textbf{16} &amp; 4.49 &amp; 3.63 &amp; 3.24 &amp; 3.01 &amp; 2.85 &amp; 2.74 &amp; 2.66 &amp; 2.59 &amp; 2.54 &amp; 2.49 \\\\<br \/>\n\\textbf{17} &amp; 4.45 &amp; 3.59 &amp; 3.20 &amp; 2.96 &amp; 2.81 &amp; 2.70 &amp; 2.61 &amp; 2.55 &amp; 2.49 &amp; 2.45 \\\\<br \/>\n\\textbf{18} &amp; 4.41 &amp; 3.55 &amp; 3.16 &amp; 2.93 &amp; 2.77 &amp; 2.66 &amp; 2.58 &amp; 2.51 &amp; 2.46 &amp; 2.41 \\\\<br \/>\n\\textbf{19} &amp; 4.38 &amp; 3.52 &amp; 3.13 &amp; 2.90 &amp; 2.74 &amp; 2.63 &amp; 2.54 &amp; 2.48 &amp; 2.42 &amp; 2.38 \\\\<br \/>\n\\textbf{20} &amp; 4.35 &amp; 3.49 &amp; 3.10 &amp; 2.87 &amp; 2.71 &amp; 2.60 &amp; 2.51 &amp; 2.45 &amp; 2.39 &amp; 2.35 \\\\<br \/>\n\\textbf{21} &amp; 4.32 &amp; 3.47 &amp; 3.07 &amp; 2.84 &amp; 2.68 &amp; 2.57 &amp; 2.49 &amp; 2.42 &amp; 2.37 &amp; 2.32 \\\\<br \/>\n\\textbf{22} &amp; 4.30 &amp; 3.44 &amp; 3.05 &amp; 2.82 &amp; 2.66 &amp; 2.55 &amp; 2.46 &amp; 2.40 &amp; 2.34 &amp; 2.30 \\\\<br \/>\n\\textbf{23} &amp; 4.28 &amp; 3.42 &amp; 3.03 &amp; 2.80 &amp; 2.64 &amp; 2.53 &amp; 2.44 &amp; 2.37 &amp; 2.32 &amp; 2.27 \\\\<br \/>\n\\textbf{24} &amp; 4.26 &amp; 3.40 &amp; 3.01 &amp; 2.78 &amp; 2.62 &amp; 2.51 &amp; 2.42 &amp; 2.36 &amp; 2.30 &amp; 2.25 \\\\<br \/>\n\\textbf{25} &amp; 4.24 &amp; 3.39 &amp; 2.99 &amp; 2.76 &amp; 2.60 &amp; 2.49 &amp; 2.40 &amp; 2.34 &amp; 2.28 &amp; 2.24 \\\\<br \/>\n\\textbf{26} &amp; 4.22 &amp; 3.37 &amp; 2.98 &amp; 2.74 &amp; 2.59 &amp; 2.47 &amp; 2.39 &amp; 2.32 &amp; 2.27 &amp; 2.22 \\\\<br \/>\n\\textbf{27} &amp; 4.21 &amp; 3.35 &amp; 2.96 &amp; 2.73 &amp; 2.57 &amp; 2.46 &amp; 2.37 &amp; 2.31 &amp; 2.25 &amp; 2.20 \\\\<br \/>\n\\textbf{28} &amp; 4.20 &amp; 3.34 &amp; 2.95 &amp; 2.71 &amp; 2.56 &amp; 2.45 &amp; 2.36 &amp; 2.29 &amp; 2.24 &amp; 2.19 \\\\<br \/>\n\\textbf{29} &amp; 4.18 &amp; 3.33 &amp; 2.93 &amp; 2.70 &amp; 2.55 &amp; 2.43 &amp; 2.35 &amp; 2.28 &amp; 2.22 &amp; 2.18 \\\\<br \/>\n\\textbf{30} &amp; 4.17 &amp; 3.32 &amp; 2.92 &amp; 2.69 &amp; 2.53 &amp; 2.42 &amp; 2.33 &amp; 2.27 &amp; 2.21 &amp; 2.16 \\\\<br \/>\n\\textbf{35} &amp; 4.12 &amp; 3.27 &amp; 2.87 &amp; 2.64 &amp; 2.49 &amp; 2.37 &amp; 2.29 &amp; 2.22 &amp; 2.16 &amp; 2.11 \\\\<br \/>\n\\textbf{40} &amp; 4.08 &amp; 3.23 &amp; 2.84 &amp; 2.61 &amp; 2.45 &amp; 2.34 &amp; 2.25 &amp; 2.18 &amp; 2.12 &amp; 2.08 \\\\<br \/>\n\\textbf{50} &amp; 4.03 &amp; 3.18 &amp; 2.79 &amp; 2.56 &amp; 2.40 &amp; 2.29 &amp; 2.20 &amp; 2.13 &amp; 2.07 &amp; 2.03 \\\\<br \/>\n\\textbf{60} &amp; 4.00 &amp; 3.15 &amp; 2.76 &amp; 2.53 &amp; 2.37 &amp; 2.25 &amp; 2.17 &amp; 2.10 &amp; 2.04 &amp; 1.99 \\\\<br \/>\n\\textbf{70} &amp; 3.98 &amp; 3.13 &amp; 2.74 &amp; 2.50 &amp; 2.35 &amp; 2.23 &amp; 2.14 &amp; 2.07 &amp; 2.02 &amp; 1.97 \\\\<br \/>\n\\textbf{80} &amp; 3.96 &amp; 3.11 &amp; 2.72 &amp; 2.49 &amp; 2.33 &amp; 2.21 &amp; 2.13 &amp; 2.06 &amp; 2.00 &amp; 1.95 \\\\<br \/>\n\\textbf{90} &amp; 3.95 &amp; 3.10 &amp; 2.71 &amp; 2.47 &amp; 2.32 &amp; 2.20 &amp; 2.11 &amp; 2.04 &amp; 1.99 &amp; 1.94 \\\\<br \/>\n\\textbf{100} &amp; 3.94 &amp; 3.09 &amp; 2.70 &amp; 2.46 &amp; 2.31 &amp; 2.19 &amp; 2.10 &amp; 2.03 &amp; 1.97 &amp; 1.93 \\\\<br \/>\n\\textbf{120} &amp; 3.92 &amp; \\textbf{3.07} &amp; 2.68 &amp; 2.45 &amp; 2.29 &amp; 2.18 &amp; 2.09 &amp; 2.02 &amp; 1.96 &amp; 1.91 \\\\\\textbf{1000} &amp; 3.85 &amp; \\textbf{3.00} &amp; 2.61 &amp; 2.38 &amp; 2.22 &amp; 2.11 &amp; 2.02 &amp; 1.95 &amp; 1.89 &amp; 1.84\\end{array}$$<\/p>\n<p>\u00a0<\/p>\n<p>As seen from the table, the critical value of the F-test for the null hypothesis to be rejected is between 3.00 and 3.07. The actual F-statistic is 2217.95, which is far higher than the F-test critical value, and thus we reject the null hypothesis that all the slope coefficients are equal to 0.<\/p>\n<h2>Calculating the Confidence Interval for the Regression Coefficient<\/h2>\n<p>Confidence interval (CI) is a closed interval in which the actual parameter is believed to lie with some degree of confidence. Confidence intervals are used to perform hypothesis tests. For instance, we may want to ascertain stock valuation using the capital asset pricing model (CAPM). In this case, we may wish to hypothesize that the beta possesses the market\u2019s systematic risk or averaged beta.<\/p>\n<p>The same analogy used in the regression analysis with one explanatory variable is also used in a multiple regression model using the t-test.<\/p>\n<h4>Example: Calculating the Confidence Interval (CI)<\/h4>\n<p>An economist tests the hypothesis that interest rates and inflation can explain GDP growth in a country. Using some 73 observations, the analyst formulates the following regression equation:<\/p>\n<p>$$\\text{GDP\u00a0growth}=\\hat{b} _0+\\hat{b}_1 (\\text{Interest})+\\hat{b}_2 (\\text{Inflation})$$<\/p>\n<p>The regression estimates are as follows:<\/p>\n<p>$$\\begin{array}{l|c|c} &amp; \\textbf{Coefficient} &amp; \\textbf{Standard Error} \\\\\\hline \\text{Intercept} &amp; 0.04 &amp; 0.6\\% \\\\ \\text{Interest rates} &amp; 0.25 &amp; 6\\% \\\\ \\text{Inflation} &amp; 0.20 &amp; 4\\% \\end{array}$$<\/p>\n<p>What is the\u00a0\u00a095% confidence interval for the coefficient on the inflation rate?<\/p>\n<p>A. 0.12024 to 0.27976<\/p>\n<p>B. 0.13024 to 0.37976<\/p>\n<p>C. 0.12324 to 0.23976<\/p>\n<p>D. 0.11324 to 0.13976<\/p>\n<p><strong>Solution<\/strong><\/p>\n<p>The correct answer is A<\/p>\n<p>From the regression analysis, \\(\\hat{\u03b2}\\) =0.20 and the estimated standard error, \\(s_\\hat{\u03b2}\\)\u00a0<sub>\u00a0\u00a0<\/sub>=0.04. The number of degrees of freedom is 73-3=70. So, the t-critical value at the 0.05 significance level is =\\(t_{\\frac{0.05}{2} ,\u00a073-2-1}=t_{0.025,70}=1.994\\). Therefore, the 95% confidence level for the stock return is:<\/p>\n<p>$$\\hat{\u03b2}\u00b1t_c s_{\\hat{\u03b2}}=0.2\u00b11.994\u00d70.04= [0.12024, 0.27976]$$<\/p>\n<blockquote>\n<h2>Practice Questions<\/h2>\n<h2>Question 1<\/h2>\n<p>An analyst runs a regression of monthly value-stock returns on four independent variables over 48 months. The total sum of squares for the regression is 360 and the sum of squared errors is 120. Calculate the R<sup>2<\/sup>.<\/p>\n<p>A. 42.1%<\/p>\n<p>B. 50%<\/p>\n<p>C. 33.3%<\/p>\n<p>D. 66.7%<\/p>\n<p>The correct answer is\u00a0<strong>D<\/strong>.<\/p>\n<p>$$ { R }^{ 2 }=\\frac { ESS }{ TSS } =\\frac {\u00a0360 &#8211; 120 }{\u00a0360 } = 66.7%$$<\/p>\n<h2>Question 2<\/h2>\n<p>Refer to the previous problem and calculate the adjusted R<sup>2<\/sup>.<\/p>\n<p>A. 27.1%<\/p>\n<p>B. 63.6%<\/p>\n<p>C. 72.9%<\/p>\n<p>D. 36.4%<\/p>\n<p>The correct answer is <b>B<\/b>.<\/p>\n<p>$$ \\begin{align*} \\bar { R } ^{ 2 }&amp;=1-\\frac { n-1 }{ n-k-1 } \\times (1 &#8211; { R }^{ 2 } )\\\\&amp;=1-\\frac { 48-1 }{ 48-4-1 } \\times (1 &#8211; 0.667 )\\\\&amp;= 63.6\\% \\end{align*}$$<\/p>\n<h2>Question 3<\/h2>\n<p>Refer to the previous problem. The analyst now adds four more independent variables to the regression and the new R<sup>2<\/sup>\u00a0increases to <b>69%<\/b>. What is the new adjusted R<sup>2<\/sup> and which model would the analyst prefer?<\/p>\n<p>A. The analyst would prefer the model with four variables because its\u00a0adjusted R<sup>2<\/sup>\u00a0is higher.<\/p>\n<p>B. The analyst would prefer the model with four variables because its\u00a0adjusted R<sup>2<\/sup>\u00a0is lower.<\/p>\n<p>C. The analyst would prefer the model with eight variables because its\u00a0adjusted R<sup>2<\/sup>\u00a0is higher.<\/p>\n<p>D. The analyst would prefer the model with eight variables because its\u00a0adjusted R<sup>2<\/sup>\u00a0is lower.<\/p>\n<p>The correct answer is\u00a0<strong>A<\/strong>.<\/p>\n<p>$$ {\u00a0 \\text{ New R } }^{ 2 }=69 \\% $$<\/p>\n<p>$$ { \\text{ New adjusted R } }^{ 2 }=1-\\frac { 48-1 }{ 48-8-1 } \\times (1 &#8211; 0.69 ) = 62.6 \\% $$<\/p>\n<p>The analyst would prefer the first model because it has a higher adjusted R<sup>2<\/sup>\u00a0and the model has four independent variables as opposed to eight.<\/p>\n<h2>Question 4<\/h2>\n<p>An economist tests the hypothesis that GDP growth in a certain country can be explained by interest rates and inflation.<\/p>\n<p>Using some 30 observations, the analyst formulates the following regression equation:<\/p>\n<p>$$ \\text{GDP growth} = { \\hat { \\beta } }_{\u00a00 } + { \\hat { \\beta } }_{ 1 } \\text{Interest}+ { \\hat { \\beta } }_{\u00a02 }\u00a0\\text{Inflation} $$<\/p>\n<p>Regression estimates are as follows:<\/p>\n<p>$$\\begin{array}{l|c|c} &amp; \\textbf{Coefficient} &amp; \\textbf{Standard Error} \\\\ \\hline \\text{Intercept} &amp; 0.10 &amp; 0.5\\% \\\\ \\text{Interest Rates} &amp; 0.20 &amp;0.05 \\\\ \\text{Inflation} &amp;0.15 &amp;0.03 \\end{array}$$<\/p>\n<p>Is the coefficient for interest rates significant at 5%?<\/p>\n<p>A. Since the test statistic\u00a0&lt; t-critical, we accept H<sub>0<\/sub>; the interest rate coefficient is\u00a0<em><strong>not<\/strong>\u00a0<\/em>significant at the 5% level.<\/p>\n<p>B. Since the test statistic &gt;\u00a0t-critical, we reject H<sub>0<\/sub>; the interest rate coefficient is\u00a0<em><strong>not<\/strong>\u00a0<\/em>significant at the 5% level.<\/p>\n<p>C. Since the test statistic &gt; t-critical, we reject H<sub>0<\/sub>; the interest rate coefficient is significant at the 5% level.<\/p>\n<p>D. Since the test statistic\u00a0&lt;\u00a0t-critical, we accept H<sub>1<\/sub>; the interest rate coefficient is<b><i>\u00a0<\/i><\/b>significant at the 5% level.<\/p>\n<p>The correct answer is\u00a0<strong>C<\/strong>.<\/p>\n<p>We have GDP growth = 0.10 + 0.20(Int) + 0.15(Inf)<\/p>\n<p>Hypothesis:<\/p>\n<p>$$ { H\u00a0}_{ 0 }:{ \\hat { \\beta } }_{ 1 } = 0 \\quad vs \\quad { H\u00a0}_{\u00a01 }:{ \\hat { \\beta } }_{ 1 }\u22600 $$<\/p>\n<p>The test statistic is:<\/p>\n<p>$$ t = \\left( \\frac {\u00a00.20 &#8211; 0 }{\u00a00.05 } \\right)\u00a0 = 4 $$<\/p>\n<p>The critical value is t<sub>(\u03b1\/2, n-k-1)<\/sub>\u00a0= t<sub>0.025,27\u00a0<\/sub>= 2.052 (which can be found on the t-table).<\/p>\n<p>$$\\begin{array}{l|cccccc} \\textbf{df\/p} &amp; \\textbf{0.40} &amp; \\textbf{0.25} &amp; \\textbf{0.10} &amp; \\textbf{0.05} &amp; \\textbf{0.025} &amp; \\textbf{0.01} \\\\ \\hline\\textbf{25} &amp; 0.256060 &amp; 0.684430 &amp; 1.316345 &amp; 1.708141 &amp; 2.05954 &amp; 2.48511 \\\\ \\textbf{26} &amp; 0.255955 &amp; 0.684043 &amp; 1.314972 &amp; 1.705618 &amp; 2.05553 &amp; 2.47863 \\\\ \\textbf{27} &amp; 0.255858 &amp; 0.683685 &amp; 1.313703 &amp; 1.703288 &amp; \\bf{\\textit{2.05183}} &amp; 2.47266 \\\\ \\textbf{28} &amp; 0.255768 &amp; 0.683353 &amp; 1.312527 &amp; 1.701131 &amp; 2.04841 &amp; 2.46714 \\\\ \\textbf{29} &amp; 0.255684 &amp; 0.683044 &amp; 1.311434 &amp; 1.699127 &amp; 2.04523 &amp; 2.46202 \\end{array}$$Decision: Since test statistic &gt; t-critical, we reject H<sub>0<\/sub>.<\/p>\n<p><b>Conclusion<\/b>: The interest rate coefficient is significant at the 5% level.<\/p>\n<\/blockquote>\n<div class=\"elfsight-widget-pricing-table elfsight-widget\" \n                data-elfsight-pricing-table-options=\"%7B%22layout%22%3A%22grid%22%2C%22skin%22%3A%22skin5%22%2C%22mainColor%22%3A%22rgb%2851%2C%20129%2C%20234%29%22%2C%22styleColumnBorderRadius%22%3Atrue%2C%22styleColumnBorderWidth%22%3Atrue%2C%22useHorizontalScroll%22%3Afalse%2C%22headTitle%22%3A%22Plan%20name%22%2C%22headFeatures%22%3A%5B%7B%22text%22%3A%22Feature%201%22%7D%2C%7B%22text%22%3A%22Feature%202%22%7D%5D%2C%22headTextColor%22%3A%22rgb%2823%2C%2025%2C%2026%29%22%2C%22headBackgroundColor%22%3A%22rgb%28247%2C%20247%2C%20247%29%22%2C%22toggleVisible%22%3Afalse%2C%22toggleItems%22%3A%5B%5D%2C%22toggleDefaultItem%22%3A%22%22%2C%22toggleColor%22%3A%22%22%2C%22columns%22%3A%5B%7B%22title%22%3A%22Practice%20Package%22%2C%22titleCaption%22%3A%22For%20FRM%20Part%20I%22%2C%22features%22%3A%5B%7B%22text%22%3A%22%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%22%22%7D%2C%7B%22text%22%3A%22%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%22%22%7D%2C%7B%22text%22%3A%22Question%20Bank%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%221%2C800%20practice%20questions%20organized%20by%20chapter%22%7D%2C%7B%22text%22%3A%22Printable%20Mock%20Exams%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%222%20mock%20exams%20for%20a%20total%20of%20200%20extra%20practice%20questions%22%7D%2C%7B%22text%22%3A%22Performance%20Tracking%20Tools%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%22View%20your%20performance%20in%20attractive%20charts%22%7D%2C%7B%22text%22%3A%225%26nbsp%3BAsk-a-tutor%20Questions%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%22Ask%20five%20questions%20to%20our%20tutors%20via%20live%20chat%22%7D%5D%2C%22price%22%3A%22249%22%2C%22priceCurrency%22%3A%22USD%22%2C%22button%22%3A%22Buy%20Now%22%2C%22buttonLink%22%3A%22https%3A%5C%2F%5C%2Fanalystprep.com%5C%2Fshop%5C%2Fpractice-package-for-frm-part-i%5C%2F%22%2C%22buttonCaption%22%3A%22%22%2C%22mainColor%22%3A%22rgb%2851%2C%20129%2C%20234%29%22%2C%22priceOptions%22%3A%5B%5D%2C%22buttonOptions%22%3A%5B%5D%2C%22isFeatured%22%3Afalse%2C%22contentDivider%22%3Anull%2C%22pricePrefix%22%3A%22%22%2C%22pricePostfix%22%3A%22%22%2C%22priceCaption%22%3A%22for%20a%2012-month%20access%22%2C%22picture%22%3A%22https%3A%5C%2F%5C%2Felfsight.com%5C%2Fassets%5C%2Fpricing-table%5C%2Fexample-grid-1.jpg%22%2C%22buttonTargetBlank%22%3Afalse%2C%22ribbonText%22%3A%22%22%2C%22ribbonBackgroundColor%22%3A%22%22%2C%22ribbonTextColor%22%3A%22%22%7D%2C%7B%22title%22%3A%22Learn%20%2B%20Practice%20Package%22%2C%22titleCaption%22%3A%22For%20FRM%20Part%20I%22%2C%22features%22%3A%5B%7B%22text%22%3A%22%3Cb%3EVideo%20Lessons%3C%5C%2Fb%3E%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%2240%20hours%5Cu2019%20worth%20of%20video%20lessons%20by%20Prof.%20James%20Forjan%2C%20PhD%22%7D%2C%7B%22text%22%3A%22%3Cb%3EStudy%20Notes%3C%5C%2Fb%3E%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%22Each%20chapter%20summarized%20%281000%20pages%20in%20total%29%22%7D%2C%7B%22text%22%3A%22%3Cb%3EQuestion%20Bank%3C%5C%2Fb%3E%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%221%2C800%20practice%20questions%20organized%20by%20chapter%22%7D%2C%7B%22text%22%3A%22%3Cb%3EPrintable%20Mock%20Exams%3C%5C%2Fb%3E%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%222%20mock%20exams%20for%20a%20total%20of%20200%20extra%20practice%20questions%22%7D%2C%7B%22text%22%3A%22%3Cb%3EPerformance%20Tracking%20Tools%3C%5C%2Fb%3E%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%22View%20your%20performance%20in%20attractive%20charts%22%7D%2C%7B%22text%22%3A%22%3Cb%3E5%26nbsp%3BAsk-a-tutor%20Questions%3C%5C%2Fb%3E%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%22Ask%20five%20questions%20to%20our%20tutors%20via%20live%20chat%22%7D%5D%2C%22price%22%3A%22399%22%2C%22priceCurrency%22%3A%22USD%22%2C%22button%22%3A%22Buy%20Now%22%2C%22buttonLink%22%3A%22https%3A%5C%2F%5C%2Fanalystprep.com%5C%2Fshop%5C%2Flearn-practice-package-for-frm-part-i%5C%2F%22%2C%22buttonCaption%22%3A%22%22%2C%22mainColor%22%3A%22rgb%2851%2C%20129%2C%20234%29%22%2C%22priceOptions%22%3A%5B%5D%2C%22buttonOptions%22%3A%5B%5D%2C%22isFeatured%22%3Atrue%2C%22contentDivider%22%3Anull%2C%22pricePrefix%22%3A%22%22%2C%22pricePostfix%22%3A%22%22%2C%22priceCaption%22%3A%22for%20a%2012-month%20access%22%2C%22buttonTargetBlank%22%3Afalse%2C%22picture%22%3A%22https%3A%5C%2F%5C%2Felfsight.com%5C%2Fassets%5C%2Fpricing-table%5C%2Fexample-grid-2.jpg%22%2C%22ribbonText%22%3A%22Most%20Popular%22%2C%22ribbonBackgroundColor%22%3A%22%22%2C%22ribbonTextColor%22%3A%22%22%7D%2C%7B%22title%22%3A%22Unlimited%20Package%22%2C%22titleCaption%22%3A%22For%20FRM%20Part%20I%20%26%20Part%20II%22%2C%22features%22%3A%5B%7B%22text%22%3A%22FRM%20Part%20I%20%26amp%3B%20Part%20II%20Video%20Lessons%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%2293%20hours%5Cu2019%20worth%20of%20video%20lessons%20by%20Prof.%20James%20Forjan%20for%20Part%20I%22%7D%2C%7B%22text%22%3A%22FRM%20Part%20I%20%26amp%3B%20II%26nbsp%3BStudy%20Notes%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%22Over%202%2C000%20pages%20worth%20of%20study%20notes%20covering%20each%20chapter%22%7D%2C%7B%22text%22%3A%22FRM%20Part%20I%20%26amp%3B%20II%26nbsp%3BQuestion%20Banks%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%224%2C100%20practice%20questions%20organized%20by%20chapter%22%7D%2C%7B%22text%22%3A%22FRM%20Part%20I%20%26amp%3B%20II%26nbsp%3BPrintable%20Mock%20Exams%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%224%20mock%20exams%20for%20a%20total%20of%20360%20extra%20practice%20questions%22%7D%2C%7B%22text%22%3A%22Performance%20Tracking%20Tools%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%22View%20your%20performance%20in%20attractive%20charts%22%7D%2C%7B%22text%22%3A%22Unlimited%26nbsp%3BAsk-a-tutor%20Questions%22%2C%22icon%22%3A%22none%22%2C%22hint%22%3A%22Ask%20questions%20to%20our%20tutors%20via%20live%20chat%22%7D%5D%2C%22price%22%3A%22699%22%2C%22priceCurrency%22%3A%22USD%22%2C%22button%22%3A%22Buy%20Now%22%2C%22buttonLink%22%3A%22https%3A%5C%2F%5C%2Fanalystprep.com%5C%2Fshop%5C%2Funlimited-package-for-frm-part-i-part-ii%5C%2F%22%2C%22buttonCaption%22%3A%22%22%2C%22mainColor%22%3A%22rgb%2851%2C%20129%2C%20234%29%22%2C%22priceOptions%22%3A%5B%5D%2C%22buttonOptions%22%3A%5B%5D%2C%22isFeatured%22%3Afalse%2C%22contentDivider%22%3Anull%2C%22pricePrefix%22%3A%22%22%2C%22pricePostfix%22%3A%22%22%2C%22priceCaption%22%3A%22for%20lifetime%20access%22%2C%22buttonTargetBlank%22%3Afalse%2C%22picture%22%3A%22https%3A%5C%2F%5C%2Felfsight.com%5C%2Fassets%5C%2Fpricing-table%5C%2Fexample-grid-3.jpg%22%2C%22ribbonText%22%3A%22%22%2C%22ribbonBackgroundColor%22%3A%22%22%2C%22ribbonTextColor%22%3A%22%22%7D%5D%2C%22elements%22%3A%5B%7B%22complexGroup%22%3A%22picture%22%2C%22name%22%3A%22Picture%22%2C%22pictureEnable%22%3Atrue%7D%2C%7B%22complexGroup%22%3A%22title%22%2C%22name%22%3A%22Title%22%2C%22titleEnable%22%3Atrue%2C%22titleCaptionColor%22%3A%22%22%2C%22titleTextColor%22%3A%22%22%2C%22titleFontSize%22%3A24%2C%22titleFontWeight%22%3A400%7D%2C%7B%22complexGroup%22%3A%22features%22%2C%22name%22%3A%22Features%22%2C%22featuresEnable%22%3Atrue%2C%22featuresStyle%22%3A%22striped%22%2C%22featuresIconColor%22%3A%22%22%2C%22featuresTextColor%22%3A%22%22%2C%22featuresAlign%22%3A%22center%22%2C%22featuresFontSize%22%3A13%7D%2C%7B%22complexGroup%22%3A%22price%22%2C%22name%22%3A%22Price%22%2C%22priceEnable%22%3Atrue%2C%22priceCaptionColor%22%3A%22%22%2C%22priceTextColor%22%3A%22%22%2C%22priceFontSize%22%3A32%2C%22priceFontWeight%22%3A600%7D%2C%7B%22complexGroup%22%3A%22button%22%2C%22name%22%3A%22Button%22%2C%22buttonEnable%22%3Atrue%2C%22buttonType%22%3A%22outline%22%2C%22buttonColor%22%3A%22%22%2C%22buttonTextColor%22%3A%22%22%2C%22buttonSize%22%3A%22medium%22%2C%22buttonCaptionColor%22%3A%22%22%7D%5D%2C%22widgetId%22%3A%221%22%7D\" \n                data-elfsight-pricing-table-version=\"2.6.1\"\n                data-elfsight-widget-id=\"elfsight-pricing-table-1\">\n            <\/div>\n            style=&#8221;max-width: 100%<\/p>\n<div style=\"background:#f3f4f6; padding:22px 18px; border-radius:14px; margin:30px 0; text-align:center;\">\n<div style=\"font-size:17px; line-height:1.4; margin-bottom:14px; color:#111827; font-weight:600;\">\n    Ready to apply OLS estimation and interpret multiple regression outputs under exam conditions?\n  <\/div>\n<p>  <a href=\"https:\/\/analystprep.com\/free-trial\/\" target=\"_blank\" rel=\"noopener noreferrer\"\n     style=\"display:inline-flex; align-items:center; justify-content:center; padding:14px 24px; border-radius:999px; background:#1d4ed8; color:#ffffff; text-decoration:none; font-weight:700; font-size:17px; line-height:1;\"><br \/>\n    Start Free Trial \u2192<br \/>\n  <\/a>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>After completing this reading, you should be able to: Distinguish between the relative assumptions of single and multiple regression. Interpret regression coefficients in multiple regression. Interpret goodness of fit measures for single and multiple regressions, including R2 and adjusted R2&#8230;.<\/p>\n","protected":false},"author":3,"featured_media":1520,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[7,16],"tags":[],"class_list":["post-1295","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-part-1","category-quantitative-analysis","blog-post","animate"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Multiple Regression Model | AnalystPrep<\/title>\n<meta name=\"description\" content=\"Learn multiple regression with several regressors, including interpretation of coefficients and how to identify and address omitted variable bias.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Multiple Regression Model | AnalystPrep\" \/>\n<meta property=\"og:description\" content=\"Learn multiple regression with several regressors, including interpretation of coefficients and how to identify and address omitted variable bias.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/\" \/>\n<meta property=\"og:site_name\" content=\"CFA, FRM, and Actuarial Exams Study Notes\" \/>\n<meta property=\"article:published_time\" content=\"2019-08-19T10:12:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-05-04T18:39:53+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/analystprep.com\/study-notes\/wp-content\/uploads\/2018\/09\/rawpixel-632449-unsplash.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2500\" \/>\n\t<meta property=\"og:image:height\" content=\"1413\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Nicolas Joyce\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Nicolas Joyce\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"17 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/frm\\\/part-1\\\/quantitative-analysis\\\/linear-regression-with-multiple-regressors\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/frm\\\/part-1\\\/quantitative-analysis\\\/linear-regression-with-multiple-regressors\\\/\"},\"author\":{\"name\":\"Nicolas Joyce\",\"@id\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/#\\\/schema\\\/person\\\/393e8b0a7757cde1d197fb0c060af25f\"},\"headline\":\"Regression with Multiple Explanatory Variables\",\"datePublished\":\"2019-08-19T10:12:00+00:00\",\"dateModified\":\"2026-05-04T18:39:53+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/frm\\\/part-1\\\/quantitative-analysis\\\/linear-regression-with-multiple-regressors\\\/\"},\"wordCount\":4487,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/frm\\\/part-1\\\/quantitative-analysis\\\/linear-regression-with-multiple-regressors\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/wp-content\\\/uploads\\\/2018\\\/09\\\/rawpixel-632449-unsplash.jpg\",\"articleSection\":[\"Part 1\",\"Quantitative Analysis\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/frm\\\/part-1\\\/quantitative-analysis\\\/linear-regression-with-multiple-regressors\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/frm\\\/part-1\\\/quantitative-analysis\\\/linear-regression-with-multiple-regressors\\\/\",\"url\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/frm\\\/part-1\\\/quantitative-analysis\\\/linear-regression-with-multiple-regressors\\\/\",\"name\":\"Multiple Regression Model | AnalystPrep\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/frm\\\/part-1\\\/quantitative-analysis\\\/linear-regression-with-multiple-regressors\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/frm\\\/part-1\\\/quantitative-analysis\\\/linear-regression-with-multiple-regressors\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/wp-content\\\/uploads\\\/2018\\\/09\\\/rawpixel-632449-unsplash.jpg\",\"datePublished\":\"2019-08-19T10:12:00+00:00\",\"dateModified\":\"2026-05-04T18:39:53+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/#\\\/schema\\\/person\\\/393e8b0a7757cde1d197fb0c060af25f\"},\"description\":\"Learn multiple regression with several regressors, including interpretation of coefficients and how to identify and address omitted variable bias.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/frm\\\/part-1\\\/quantitative-analysis\\\/linear-regression-with-multiple-regressors\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/frm\\\/part-1\\\/quantitative-analysis\\\/linear-regression-with-multiple-regressors\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/frm\\\/part-1\\\/quantitative-analysis\\\/linear-regression-with-multiple-regressors\\\/#primaryimage\",\"url\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/wp-content\\\/uploads\\\/2018\\\/09\\\/rawpixel-632449-unsplash.jpg\",\"contentUrl\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/wp-content\\\/uploads\\\/2018\\\/09\\\/rawpixel-632449-unsplash.jpg\",\"width\":2500,\"height\":1413},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/frm\\\/part-1\\\/quantitative-analysis\\\/linear-regression-with-multiple-regressors\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Regression with Multiple Explanatory Variables\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/#website\",\"url\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/\",\"name\":\"CFA, FRM, and Actuarial Exams Study Notes\",\"description\":\"Question Bank and Study Notes for the CFA, FRM, and Actuarial exams\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/#\\\/schema\\\/person\\\/393e8b0a7757cde1d197fb0c060af25f\",\"name\":\"Nicolas Joyce\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/684508c19e959bb01da12a9dc741428f559e4e5df43fc41ed68efa7f2d3b2b9d?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/684508c19e959bb01da12a9dc741428f559e4e5df43fc41ed68efa7f2d3b2b9d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/684508c19e959bb01da12a9dc741428f559e4e5df43fc41ed68efa7f2d3b2b9d?s=96&d=mm&r=g\",\"caption\":\"Nicolas Joyce\"},\"url\":\"https:\\\/\\\/analystprep.com\\\/study-notes\\\/author\\\/kajal\\\/\"}]}<\/script>\n<meta property=\"og:video\" content=\"https:\/\/www.youtube.com\/embed\/XWaj2sqrZG4\" \/>\n<meta property=\"og:video:type\" content=\"text\/html\" \/>\n<meta property=\"og:video:duration\" content=\"1951\" \/>\n<meta property=\"og:video:width\" content=\"480\" \/>\n<meta property=\"og:video:height\" content=\"270\" \/>\n<meta property=\"ya:ovs:adult\" content=\"false\" \/>\n<meta property=\"ya:ovs:upload_date\" content=\"2019-08-19T10:12:00+00:00\" \/>\n<meta property=\"ya:ovs:allow_embed\" content=\"true\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Multiple Regression Model | AnalystPrep","description":"Learn multiple regression with several regressors, including interpretation of coefficients and how to identify and address omitted variable bias.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/","og_locale":"en_US","og_type":"article","og_title":"Multiple Regression Model | AnalystPrep","og_description":"Learn multiple regression with several regressors, including interpretation of coefficients and how to identify and address omitted variable bias.","og_url":"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/","og_site_name":"CFA, FRM, and Actuarial Exams Study Notes","article_published_time":"2019-08-19T10:12:00+00:00","article_modified_time":"2026-05-04T18:39:53+00:00","og_image":[{"width":2500,"height":1413,"url":"https:\/\/analystprep.com\/study-notes\/wp-content\/uploads\/2018\/09\/rawpixel-632449-unsplash.jpg","type":"image\/jpeg"}],"author":"Nicolas Joyce","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Nicolas Joyce","Est. reading time":"17 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/#article","isPartOf":{"@id":"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/"},"author":{"name":"Nicolas Joyce","@id":"https:\/\/analystprep.com\/study-notes\/#\/schema\/person\/393e8b0a7757cde1d197fb0c060af25f"},"headline":"Regression with Multiple Explanatory Variables","datePublished":"2019-08-19T10:12:00+00:00","dateModified":"2026-05-04T18:39:53+00:00","mainEntityOfPage":{"@id":"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/"},"wordCount":4487,"commentCount":0,"image":{"@id":"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/#primaryimage"},"thumbnailUrl":"https:\/\/analystprep.com\/study-notes\/wp-content\/uploads\/2018\/09\/rawpixel-632449-unsplash.jpg","articleSection":["Part 1","Quantitative Analysis"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/","url":"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/","name":"Multiple Regression Model | AnalystPrep","isPartOf":{"@id":"https:\/\/analystprep.com\/study-notes\/#website"},"primaryImageOfPage":{"@id":"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/#primaryimage"},"image":{"@id":"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/#primaryimage"},"thumbnailUrl":"https:\/\/analystprep.com\/study-notes\/wp-content\/uploads\/2018\/09\/rawpixel-632449-unsplash.jpg","datePublished":"2019-08-19T10:12:00+00:00","dateModified":"2026-05-04T18:39:53+00:00","author":{"@id":"https:\/\/analystprep.com\/study-notes\/#\/schema\/person\/393e8b0a7757cde1d197fb0c060af25f"},"description":"Learn multiple regression with several regressors, including interpretation of coefficients and how to identify and address omitted variable bias.","breadcrumb":{"@id":"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/#primaryimage","url":"https:\/\/analystprep.com\/study-notes\/wp-content\/uploads\/2018\/09\/rawpixel-632449-unsplash.jpg","contentUrl":"https:\/\/analystprep.com\/study-notes\/wp-content\/uploads\/2018\/09\/rawpixel-632449-unsplash.jpg","width":2500,"height":1413},{"@type":"BreadcrumbList","@id":"https:\/\/analystprep.com\/study-notes\/frm\/part-1\/quantitative-analysis\/linear-regression-with-multiple-regressors\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/analystprep.com\/study-notes\/"},{"@type":"ListItem","position":2,"name":"Regression with Multiple Explanatory Variables"}]},{"@type":"WebSite","@id":"https:\/\/analystprep.com\/study-notes\/#website","url":"https:\/\/analystprep.com\/study-notes\/","name":"CFA, FRM, and Actuarial Exams Study Notes","description":"Question Bank and Study Notes for the CFA, FRM, and Actuarial exams","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/analystprep.com\/study-notes\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/analystprep.com\/study-notes\/#\/schema\/person\/393e8b0a7757cde1d197fb0c060af25f","name":"Nicolas Joyce","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/684508c19e959bb01da12a9dc741428f559e4e5df43fc41ed68efa7f2d3b2b9d?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/684508c19e959bb01da12a9dc741428f559e4e5df43fc41ed68efa7f2d3b2b9d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/684508c19e959bb01da12a9dc741428f559e4e5df43fc41ed68efa7f2d3b2b9d?s=96&d=mm&r=g","caption":"Nicolas Joyce"},"url":"https:\/\/analystprep.com\/study-notes\/author\/kajal\/"}]},"og_video":"https:\/\/www.youtube.com\/embed\/XWaj2sqrZG4","og_video_type":"text\/html","og_video_duration":"1951","og_video_width":"480","og_video_height":"270","ya_ovs_adult":"false","ya_ovs_upload_date":"2019-08-19T10:12:00+00:00","ya_ovs_allow_embed":"true"},"_links":{"self":[{"href":"https:\/\/analystprep.com\/study-notes\/wp-json\/wp\/v2\/posts\/1295","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/analystprep.com\/study-notes\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/analystprep.com\/study-notes\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/analystprep.com\/study-notes\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/analystprep.com\/study-notes\/wp-json\/wp\/v2\/comments?post=1295"}],"version-history":[{"count":110,"href":"https:\/\/analystprep.com\/study-notes\/wp-json\/wp\/v2\/posts\/1295\/revisions"}],"predecessor-version":[{"id":42417,"href":"https:\/\/analystprep.com\/study-notes\/wp-json\/wp\/v2\/posts\/1295\/revisions\/42417"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/analystprep.com\/study-notes\/wp-json\/wp\/v2\/media\/1520"}],"wp:attachment":[{"href":"https:\/\/analystprep.com\/study-notes\/wp-json\/wp\/v2\/media?parent=1295"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/analystprep.com\/study-notes\/wp-json\/wp\/v2\/categories?post=1295"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/analystprep.com\/study-notes\/wp-json\/wp\/v2\/tags?post=1295"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}