Functional Forms for Simple Linear Regression

Functional Forms for Simple Linear Regression

For non-linear relationships, we can use several functional forms to potentially transform the data to be used in linear regression. The following are the three often-used log transformation functional forms:

  1. Log-lin model: In this log transformation, the dependent variable is logarithmic while the independent variable is linear. It is represented as \(lnY_i = b_0 + b_1 X_i\). The slope coefficient in the log-lin model is the relative change in the dependent variable for an absolute change in the independent variable. That is, a one-unit increment in \(X\) triggers a \(100b_1\) percent change in \(Y\).
  2. Lin-log model: In this case, the dependent variable is linear while the independent variable is logarithmic. It is represented as \(Y_i = b_0 + b_1 lnX_i\). The slope coefficient in the lin-log model is responsible for the absolute change in the dependent variable for a relative change in the independent variable. Put another way, if X increases by 1%, \(Y\) will change by \(b_1\) per 100 units.
  3. Log-log model: In this log transformation, both the dependent and independent variables are logarithmic. It is represented as \(lnY_i = b_0 + b_1 lnX_i\). The slope coefficient in the log-log model is the relative change in the dependent variable for a relative change in the independent variable. In other words, if \(X\) increases by 1%, \(Y\) will change by \(b_1\)

Selecting the Correct Functional Form

To settle on the correct functional form, consider the following goodness of fit measures:

  1. Coefficient of determination (R2). High value of is better.
  2. F-statistic. High value of F-statistic is better.
  3. Standard error of the estimate (Se). A low value of Se is better.

Aside from the factors cited above, the patterns in residuals can also be analyzed when evaluating a  model.  Residuals are random and uncorrelated in a good model.

Shop CFA® Exam Prep

Offered by AnalystPrep

Featured Shop FRM® Exam Prep Learn with Us

    Subscribe to our newsletter and keep up with the latest and greatest tips for success
    Shop Actuarial Exams Prep Shop Graduate Admission Exam Prep


    Sergio Torrico
    Sergio Torrico
    2021-07-23
    Excelente para el FRM 2 Escribo esta revisión en español para los hispanohablantes, soy de Bolivia, y utilicé AnalystPrep para dudas y consultas sobre mi preparación para el FRM nivel 2 (lo tomé una sola vez y aprobé muy bien), siempre tuve un soporte claro, directo y rápido, el material sale rápido cuando hay cambios en el temario de GARP, y los ejercicios y exámenes son muy útiles para practicar.
    diana
    diana
    2021-07-17
    So helpful. I have been using the videos to prepare for the CFA Level II exam. The videos signpost the reading contents, explain the concepts and provide additional context for specific concepts. The fun light-hearted analogies are also a welcome break to some very dry content. I usually watch the videos before going into more in-depth reading and they are a good way to avoid being overwhelmed by the sheer volume of content when you look at the readings.
    Kriti Dhawan
    Kriti Dhawan
    2021-07-16
    A great curriculum provider. James sir explains the concept so well that rather than memorising it, you tend to intuitively understand and absorb them. Thank you ! Grateful I saw this at the right time for my CFA prep.
    nikhil kumar
    nikhil kumar
    2021-06-28
    Very well explained and gives a great insight about topics in a very short time. Glad to have found Professor Forjan's lectures.
    Marwan
    Marwan
    2021-06-22
    Great support throughout the course by the team, did not feel neglected
    Benjamin anonymous
    Benjamin anonymous
    2021-05-10
    I loved using AnalystPrep for FRM. QBank is huge, videos are great. Would recommend to a friend
    Daniel Glyn
    Daniel Glyn
    2021-03-24
    I have finished my FRM1 thanks to AnalystPrep. And now using AnalystPrep for my FRM2 preparation. Professor Forjan is brilliant. He gives such good explanations and analogies. And more than anything makes learning fun. A big thank you to Analystprep and Professor Forjan. 5 stars all the way!
    michael walshe
    michael walshe
    2021-03-18
    Professor James' videos are excellent for understanding the underlying theories behind financial engineering / financial analysis. The AnalystPrep videos were better than any of the others that I searched through on YouTube for providing a clear explanation of some concepts, such as Portfolio theory, CAPM, and Arbitrage Pricing theory. Watching these cleared up many of the unclarities I had in my head. Highly recommended.