A Review of Multiple Linear Regression’s Uses

A Review of Multiple Linear Regression’s Uses

Multiple linear regression describes the variation of the dependent variable by using two or more independent variables. When used properly, it can improve predictions. However, if used incorrectly, it can create spurious relationships that can undermine predictions.

Typically, a multiple regression model takes the following form:

$$ Y_i=b_0+b_1X_{1,i}+b_2X_{2,i}+\ldots+b_kX_{k,i}+\epsilon_i $$

Where:

\(Y_i\) = Dependent variable.

\(b_0\) = Intercept term.

\(b_1,b_2,\ldots, b_k\) = Slope coefficients.

\(X_{1,i},X_{2,i},\ldots,X_{k,i}\) = Independent variables.

\(\epsilon_i\) = Error term.

\(n\) = Number of observations.

A regression equation has \(k\) slope coefficients and \(k+1\) regression coefficients.

The intercept term is defined as the value of the dependent variable when the independent variables are zero. On the other hand, the slope coefficient is defined as the estimated change in the dependent variable given a one-unit change in the independent variable, keeping the other independent variables constant.

Researchers can use multiple regression to test existing theories, identify relationships between variables, or forecast.

The researcher must specify the model to determine the good-fit criteria for the regression model, including an independent variable. Once the regression model has been specified, it must be estimated and analyzed to ensure it satisfies all the key assumptions.

It is equally noteworthy that a researcher can use multiple regression to test existing forecasting theories. Alternatively, multiple regression can further be used to identify relationships between variables after the model is tested and deemed acceptable for out-of-sample performance.

A single factor cannot adequately explain or forecast the complex world of investments. Due to their complexity, statistical tests and fundamental justification are critical in the exhaustive explanation of financial and economic relations.

There are several ways to use multiple regression, including:

  • A company’s profitability, growth, revenue, and market share are variables that an investor is interested in. These variables can predict if a company will run into financial difficulties.
  • An analyst seeking to determine how a company’s stock price and trading volume change daily can correlate them. An analyst can use linear regression to determine the relationship between variables.

Question

Which of the following most accurately detects whether the underlying assumptions of multiple linear regression models are satisfied?

  1. Scatter plots.
  2. Residual plots.
  3. Diagnostic plots.

Solution

The correct answer is C.

Diagnostic plots for multiple regression show the prediction errors against predicted values. Therefore, they are useful in the determination of the gaps that a researcher should address in their data to improve the accuracy of their predictions.  Using diagnostic plots, a researcher can determine whether the assumptions of multiple linear regression are valid.

A is incorrect. The scatterplot is useful for detecting nonlinear relationships between dependent and independent variables.

B is incorrect. A residual plot is an effective tool for detecting violations of homoskedasticity and error independence.

Shop CFA® Exam Prep

Offered by AnalystPrep

Featured Shop FRM® Exam Prep Learn with Us

    Subscribe to our newsletter and keep up with the latest and greatest tips for success
    Shop Actuarial Exams Prep Shop Graduate Admission Exam Prep


    Daniel Glyn
    Daniel Glyn
    2021-03-24
    I have finished my FRM1 thanks to AnalystPrep. And now using AnalystPrep for my FRM2 preparation. Professor Forjan is brilliant. He gives such good explanations and analogies. And more than anything makes learning fun. A big thank you to Analystprep and Professor Forjan. 5 stars all the way!
    michael walshe
    michael walshe
    2021-03-18
    Professor James' videos are excellent for understanding the underlying theories behind financial engineering / financial analysis. The AnalystPrep videos were better than any of the others that I searched through on YouTube for providing a clear explanation of some concepts, such as Portfolio theory, CAPM, and Arbitrage Pricing theory. Watching these cleared up many of the unclarities I had in my head. Highly recommended.
    Nyka Smith
    Nyka Smith
    2021-02-18
    Every concept is very well explained by Nilay Arun. kudos to you man!
    Badr Moubile
    Badr Moubile
    2021-02-13
    Very helpfull!
    Agustin Olcese
    Agustin Olcese
    2021-01-27
    Excellent explantions, very clear!
    Jaak Jay
    Jaak Jay
    2021-01-14
    Awesome content, kudos to Prof.James Frojan
    sindhushree reddy
    sindhushree reddy
    2021-01-07
    Crisp and short ppt of Frm chapters and great explanation with examples.