Part 2 APPROXIMATION METHODS

MAT 295

Chapter 11

Newtons
Method
At the end of this chapter, students should be able to:

Derive Newtons method graphically and algebraically

Apply Newtons method

11.1 Introduction
In Chapter 10, the bisection method of solving non-linear equations has been
discussed. Based on the given examples it can be concluded that if the
existence of a root is guaranteed then the method will always converge to the
required root. Nevertheless one of the disadvantages is that the convergence
rate is slow.
Is there a method which has a better convergence rate? One of the favourite
numerical methods of solving non-linear equation is known as the Newtons
method or the Newton-Raphson. This method is attributed to Sir Isaac
Newton (1643-1727) and Joseph Raphson (1648-1715). If the bisection
method applies a vertical line to do its approximation, Newtons method on
the other hand will make the use of a tangent line at a point.

11.2 Newtons Method

Being one of the most widely used method of root finding, the procedure
attempts to find a solution of the equation f ( x ) 0 where f (x ) is a continuous
and differentiable function of one variable.

147

Part 2 APPROXIMATION METHODS

MAT 295

In the Newtons method, approximation is done by using tangential lines. The

solution process begins with choosing a value as the first estimate of the
solution (normally obtained from graphing). This initial value is sometimes
called the initial guess. The second estimate is obtained by taking the
tangent line to f (x ) at the initial value. The third estimate is obtained by taking
the tangent line to f (x ) at the second estimate. The process goes on and on
until desired accuracy is achieved.

Geometric Derivation
Let us consider a differentiable function f (x )

and the problem of

approximating a zero r of f (x ) which is known to lie between the

numbers x a and x b . Newtons method of approximating r calls for an
initial guess x 0 to be made. The line L0 tangent to the graph of y f (x ) at
(x0 , f ( x0 )) is then constructed. By finding the x-intercept x1 of L0 , we obtain

a second approximation to r. Newtons famous observation is simply that for

many functions the second approximation x1 is better than the first x 0 .
y

y f (x )

L0

Actual
root r

x
x2

x1

x0

Figure 11.1

If the procedure is then repeated by finding the line L1 tangent to the graph
of f at (x1, f ( x1)) , the x-intercept of L1 (say x 2 ) provides an even closer
approximation to r than x1 . The procedure is repeated again and again,
until an approximation of sufficiently high accuracy is obtained.

148

Part 2 APPROXIMATION METHODS

MAT 295

We can obtain a simple equation for obtaining the (n + 1)th approximation,

xn 1 , from the nth approximation, x n by considering Figure 11.2.
y

y f (x )

Ln

Ln1

Actual
root r
xn1

xn

Figure 11.2
Since the slope of line Ln tangent to the graph of y f (x ) at (xn , f ( xn )) is
given by the derivative f ' ( xn ) , the equation for Ln can be written as:
y f ( xn ) f ' ( xn )x xn

(1)

To find xn 1 , the intercept of Ln , we set y = 0 and solve for x in equation

(1). We obtain:

x xn

f ( xn )
f ' ( xn ) ;

f ' (xn ) 0

Since this is the desired approximation x xn 1 , we have the approximation

scheme for Newtons method:

xn 1 xn

f ( xn )
f ' ( xn )

f ' (xn ) 0

Algebraic Derivation
Another possibility is to derive the Newtons method is based upon the Taylor
polynomial. Suppose that the function

f (x )

is twice continuously

differentiable on the interval [a, b]. Let xn [a, b] be an approximation to r

such that f ' (xn ) 0 and

xn - r

is small. Consider the second-degree

Taylor polynomial for f (x ) , expanded about x n

f(x) f(xn ) (r - x n )f ' (xn )

(r - x n ) 2
f " ( )
2

(1)

where in between x and x n . Since f (r ) 0 , with x = r, gives

149

Part 2 APPROXIMATION METHODS

0 f(xn ) (r - x n )f ' (xn )

Since

(r - x n ) 2
f()
2

was assumed to be small,

xn - r

MAT 295

xn - r

is even smaller, and if this

quantity is assumed to be negligible, then

0 f(xn ) (r - xn )f ' (xn )

Solving for r in this equation gives:

r xn

f ( xn )
f ' ( xn )

which should be a better approximation to r than is x n . This sets the stage

for the Newton-Raphson or Newtons method
xn 1 x n -

f(xn )
f ' (xn )

Steps : Newtons method

Identify the equation and determine f (x )

Find the derivative f ' ( x )
Identify initial value x 0
Evaluate f (x ) and f ' ( x ) at x0

Repeat until desired iterations/accuracy

Apply Newtons method

f ( xn )
x n 1 xn
f ' ( xn )

Example 1
For the equation

x - cosx 0 , use the Newtons method with three

iterations to estimate the root given x0 1.4. What can be said about the
accuracy of the estimated value (root)?

Solution

Identify the equation and determine f (x )

x - cosx 0

Find the derivative f ' ( x )

f ' (x)

1
2 x

sinx

150

f ( x ) x - cosx

Part 2 APPROXIMATION METHODS

MAT 295

Identify initial value x0

x0 1.4

Evaluate f (x ) and f ' ( x ) at x0

f (1.4) 1.013
f ' (1.4) 1.408

Apply Newtons method

x1 x0

f ( x0 )
f ' ( x0 )

1.013
1.408
0.681

x1 1.4

Repeat until desired iterations/accuracy

f ( x ) x - cosx

f ' (x)

1
2 x

sinx

x
0
1
2

1.4
0.681
0.642

1.013
0.048
0.000

1.408
1.235
1.223

Newton
0.681
0.642
0.642

Hence, after 3 iterations, the estimated root is 0.642 (accurate to 3D).

Example 2
The solution of the equation e x 2 x is known to exists between 0 and
1. Estimate the root to 2 decimal places using Newtons method.

Solution

Identify the equation and determine f (x )

ex 2 x
ex x 2 0

f (x) ex x 2

Find the derivative f ' ( x )

f ' (x) ex 1

Identify initial value; x 0

x0 0.5

Evaluate f (x ) and f ' ( x ) at x 0

151

Part 2 APPROXIMATION METHODS

MAT 295

f (0.5) 0.149
f ' (0.5) 2.649

Apply Newtons method

x1 x0

f ( x0 )
f ' ( x0 )

0.149
2.649
0.444
0.5

Repeat until desired iterations/accuracy

i
0
1

f (x) ex x 2

x
0.5
0.4439

f ' (x) ex 1

0.149
0.003

2.649
2.559

Newton
0.444
0.443

Hence, the estimated root correct to 2 decimal places is 0.44.

Example 3
Apply Newtons method to approximate the root of h( x ) x 3 x 1 to 2
significant digits.

Solution

Given
h( x ) x 3 x 1

h' ( x ) 3 x 2 1

Let x0 1 , then
x1 x0
1

f ( x0 )
f ' ( x0 )
1
2

1.5

x
-1
-1.5
-1.348
-1.325

f (x )

f ' (x)

1
-0.875
-0.101
-0.001

2
5.750
4.451
4.267

Newton
-1.5
-1.348
-1.325
-1.325

Hence, the estimated root correct to 2 significant digits is -1.3.

152

Part 2 APPROXIMATION METHODS

MAT 295

Example 4
Determine the formula for Newtons method to approximate 3 a .

Solution

Identify the equation and determine f (x )

The problem is to determine the root x 3 a , which can be rewritten
as

x3 a
3

x a 0

then f ( x ) x 3 a

Find the derivative f ' ( x )

f ' ( x ) 3x 2
Identify initial value
xn

Evaluate f (x ) and f ' ( x ) at x n

f ( xn ) xn 3 a

f ' ( xn ) 3 xn 2

Apply Newtons method

x3 a
x n 1 x n n
3 x n2
x
a
xn n
3 3 x n2

Warm up exercise
Let x 3 - 2x - 5 0 where 2 r 3 .
(i)
(ii)
(iii)
(iv)
(v)

(vi)

Identify the equation and determine f (x )

Find the derivative f ' ( x )
Identify initial value x0
Evaluate f (x ) and f ' ( x ) at x0
Apply Newtons method to determine
f ( x0 )
x1 x0
f ' ( x0 )
Determine the third iteration.

153

Part 2 APPROXIMATION METHODS

MAT 295

Exercise 11
1.

Apply Newtons method to the equation x 3 6x 16 0 with x0 0 and try

to determine the root correct to three decimal places.

2.

Determine the first four approximations of the actual root of the equation

x3
3.

1
0 in the interval [0, 1], using the Newtons method.
2

Use Newtons method to find the point in the right half-plane where the graphs
of f ( x ) 2x 3 and g( x ) 5x 1 intersects.

4.

Apply Newtons method to the equation sin x 0.75 0 .

5.

By Newtons method, determine the first three approximations of the

following equations in the given interval.

6.

(a) sin x x 3 1 0 ;

[-2, 0]

(b) x ln x 3 0 ;

[4, 5]

(c) f ( x ) cos x cos 3x ;

2 , 2

(d) 2x tan x ;

[0, 3]

Show that x 3 x 2 0 has a root between 1 and 2. Use Newton method, to

approximate the root accurate to two decimal places.

7.

Using Newtons method, solve x ln x 3 , given that the root is close to 2.

Obtain the root correct to two decimal places.

8.

Use Newtons method to approximate the zero of f ( x ) 1 x x 2 . If

x0 0.4 give your answers accurate to 2 significant digits.

9.

Solve 2 cos x e x accurate to three decimal places using Newtons method.

10.

By Newton's method, estimate the solution to x 2 77 0 . Give your answer

correct to 3 decimal places.

11.

Approximate by using Newton's method to find a solution of sin x 0 ,

starting with x0 3 . How many iterations are needed until the solution is
accurate to 3 decimal places?

12.

Approximate the root(s) of h( x ) 2x 3 4 x 2 . How many real roots does h

have?

13.

Find a solution to the equation x 3 x 1 that is near x0 1.5 using three

iterations.

154