Assumptions of Multiple Regression Model

Assumptions of Multiple Regression Model

Multiple regression models are built on the following assumptions.

  • The relationship between the dependent variable, \(Y\), and the independent variables, \(X_{1}, X_{2},…, X_{k}\) is linear.
  • The independent variables \((X_{1}, X_{2},…, X_{k})\) are not random.
  • There exists no definite linear relationship between two or more of the independent variables. A high correlation between two or more independent variables is known as multicollinearity.
  • The expected value of the error term, conditional on the independent variables, is equal to 0.

$$E(\epsilon|X_{1}, X_{2},…, X_{k})=0$$

  • The variance of the error term is equal for all observations.

$$E(\epsilon_{i}^{2})=\sigma_{\epsilon}^{2}, i=1,2,…,n$$

           (This is known as the homoskedasticity assumption.)

  • The error term is uncorrelated across all observations.

$$E(\epsilon_{i}\epsilon_{j})=0 {}∀ i≠j$$

Question

Which of the following is least likely an assumption of the multiple linear regression model?

    A. The independent variables are not random.

    B. The error term is correlated across all observations.

    C. The expected value of the error term, conditional on the independent variables, is equal to zero.

Solution

The correct answer is B.

The error term is uncorrelated across all observations.

$$E(\epsilon_{i}\epsilon_{j})=0 ∀i≠j$$

Other assumptions of the classical normal multiple linear regression model include:

    i. The independent variables are not random. Additionally, there is no exact linear relationship between two or more of the independent variables.

   ii. The error term is normally distributed.

  iii. The expected value of the error term, conditional on the independent variables, is equal to 0.

  iv. The variance of the error term is the same for all observations.

  v. A linear relation exists between the dependent variable and the independent variables.

Reading 2: Multiple Regression

LOS 2 (f) Explain the assumptions of a multiple regression model.

Shop CFA® Exam Prep

Offered by AnalystPrep

Featured Shop FRM® Exam Prep Learn with Us

    Subscribe to our newsletter and keep up with the latest and greatest tips for success
    Shop Actuarial Exams Prep Shop Graduate Admission Exam Prep


    Daniel Glyn
    Daniel Glyn
    2021-03-24
    I have finished my FRM1 thanks to AnalystPrep. And now using AnalystPrep for my FRM2 preparation. Professor Forjan is brilliant. He gives such good explanations and analogies. And more than anything makes learning fun. A big thank you to Analystprep and Professor Forjan. 5 stars all the way!
    michael walshe
    michael walshe
    2021-03-18
    Professor James' videos are excellent for understanding the underlying theories behind financial engineering / financial analysis. The AnalystPrep videos were better than any of the others that I searched through on YouTube for providing a clear explanation of some concepts, such as Portfolio theory, CAPM, and Arbitrage Pricing theory. Watching these cleared up many of the unclarities I had in my head. Highly recommended.
    Nyka Smith
    Nyka Smith
    2021-02-18
    Every concept is very well explained by Nilay Arun. kudos to you man!
    Badr Moubile
    Badr Moubile
    2021-02-13
    Very helpfull!
    Agustin Olcese
    Agustin Olcese
    2021-01-27
    Excellent explantions, very clear!
    Jaak Jay
    Jaak Jay
    2021-01-14
    Awesome content, kudos to Prof.James Frojan
    sindhushree reddy
    sindhushree reddy
    2021-01-07
    Crisp and short ppt of Frm chapters and great explanation with examples.