4.10 Nonlinear Regression

The regression models we have seen are linear models. However, at times there exist nonlinear relationships between variables. Some simple variable transformations can be used to create an apparently linear model from a nonlinear relationship. This allows us to use Excel and other linear regression programs to perform the calculations. We will demonstrate this in the following example.

On every new automobile sold in the United States, the fuel efficiency (as measured by miles per gallon [MPG] of gasoline) of the automobile is prominently displayed on the window sticker. The MPG is related to several factors, one of which is the weight of the automobile. Engineers at Colonel Motors, in an attempt to improve fuel efficiency, have been asked to study the impact of weight on MPG. They have decided that a regression model should be used to do this.

A sample of 12 new automobiles was selected, and the weight and MPG rating were recorded. Table 4.6 provides these data. A scatter diagram of the data in Figure 4.6A shows the weight and MPG. A linear regression line is drawn through the points. Excel was used to develop a simple linear regression equation to relate the MPG (Y) to the weight in thousands of pounds (X1) in the form

Table 4.6 Automobile Weight Versus MPG

MPG WEIGHT (1,000s LB.) MPG WEIGHT (1,000s LB.)
12 4.58 20 3.18
13 4.66 23 2.68
15 4.02 24 2.65
18 2.53 33 1.70
19 3.09 36 1.95
19 3.11 42 1.92
Y^=b0+b1X1

The Excel output is shown in Program 4.6. From this, we get the equation

Y^=47.68.2X1

or

MPG=47.68.21Weight in thousands of pounds)

The model is useful since the significance level for the F test is small and r2=0.7446. However, further examination of the graph in Figure 4.6A brings into question the use of a linear model. Perhaps a nonlinear relationship exists, and maybe the model should be modified to account for this. A quadratic model is illustrated in Figure 4.6B. This model would be of the form

MPG=b0+b1(Weight)+b2(Weight)2
A scatter diagram with Weight in thousands of pounds, ranging from zero to 5.00 in increments of 1.00, plotted on the horizontal axis and MPG, ranging from zero to 45 in increments of 5, on the vertical axis.

Figure 4.6A Linear Model for MPG Data

A scatter diagram with Weight in thousands of pounds, ranging from zero to 5.00 in increments of 1.00, plotted on the horizontal axis and MPG, ranging from zero to 45 in increments of 5, on the vertical axis.

Figure 4.6B Nonlinear Model for MPG Data

The easiest way to develop this model is to define a new variable

X2=(Weight)2

This gives us the model

Y^=b0+b1X1+b2X2

We can create another column in Excel and again run the regression tool. The output is shown in Program 4.7. The new equation is

Y^=79.830.2X1+3.4X2

The significance level for F is low (0.0002), so the model is useful, and r2=0.8478. The adjusted r2 increased from 0.719 to 0.814, so this new variable definitely improved the model.

This model is good for prediction purposes. However, we should not try to interpret the coefficients of the variables due to the correlation between X1 (weight) and X2 (weight squared). Normally, we would interpret the coefficient for X1 as the change in Y that results from a 1-unit change in X1, while holding all other variables constant. Obviously, holding one variable constant while changing the other is impossible in this example, since X2=X12. If X1 changes, then X2 must change also. This is an example of a problem that exists when multicollinearity is present.

Screenshot showing results for Automobile Weight versus MPG.

Program 4.6 Excel 2016 Output with Linear Regression Model for MPG Data

Another screenshot of results for Automobile Weight versus MPG.

Program 4.7 Excel 2016 Output with Nonlinear Regression Model for MPG Data

Other types of nonlinearities can be handled using a similar approach. A number of transformations exist that may help to develop a linear model from variables with nonlinear relationships.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset