See

discussions, stats, and author profiles for this publication at:

https://www.researchgate.net/publication/280311277

Introduction to Numerical Analysis

Book August 2015

CITATIONS READS

3 2,868

3 authors:

Rostam K Saeed Karwan Jwamer

Salahaddin University - Erbil University of Sulaimani
70 PUBLICATIONS 117 CITATIONS 54 PUBLICATIONS 78 CITATIONS

SEE PROFILE SEE PROFILE

Faraidun Salh
University of Sulaimani
52 PUBLICATIONS 59 CITATIONS

SEE PROFILE

Some of the authors of this publication are also working on these related projects:

I published first book based on my PhD. Dissertasion and now, I am preparing for
publishing two books based on my D.Sc. research work. Further, I will publish two other
books. View project

Bubble dynamic, fluid mechanic View project

All content following this page was uploaded by Rostam K Saeed on 23 July 2015.

The user has requested enhancement of the downloaded file.

Iraq Kurdistan Region
Ministry of Higher Education and Scientific Research
University of Sulaimani
Faculty of Science and Science Education
School of Science Education-Mathematics Department

Introduction to
Numerical Analysis
First Edition

Rostam K. Saeed
Karwan H.F. Jwamer
Faraidun K. Hamasalh
Sulaimani, Kurdistan Region- Iraq, 2015 2015
Introduction to
Numerical Analysis
First Edition

Rostam K. Saeed
Department of Mathematics, College of Science, Salahaddin
University/Erbil, Kurdistan Region, Hawler, Iraq.

Karwan H.F. Jwamer

Department of Mathematics, School of Science, University of
Sulaimani, Kurdistan Region, Sulaimani, Iraq.

Faraidun K. Hamasalh
Department of Mathematics, School of Science Education,
University of Sulaimani, , Kurdistan Region, Sulaimani, Iraq.

Sulaimani, Kurdistan Region- Iraq, 2015

Copyright 2015 by Rostam K. Saeed, Karwan H.F. Jwamer and Faraidun K.
Hamasalh . First Edition published 2015 by University of Sulaimani,
Sulaimani, Kurdistan Region- Iraq.
Printed by Pasha print , 2015, Sulaimani, Kurdistan Region- Iraq.

Bibliography:
Includes index
Numerical Analysis
Rostam K. Saeed, Karwan H.F. Jwamer and Faraidun K. Hamasalh
 Preface

After several years as lecture in Numerical Analysis, we felt that the

books that were available on the subject were written in such a way that the
students found them difficult to understand. Its hard for students whose
mother language is not English, so we decided that we should try to compose
a book on Numerical Analysis that is suitable for students in the Mathematics
and Physics departments in College of Science, College of Education, and
College of Engineering.
This book will primarily function as an abbreviation of the Numerical
Analysis course that student in a number of different colleges study. It can be
used as an introductory handbook for students from many different
backgrounds and academic levels. It is a known fact that Numerical Analysis
is not just a science, it requires picking through different methods for the sake
of solving the problem at hand. Examples and solutions at the end of each
chapter have been provided which would help the students.
While writing the chapters, we tried to write in a suitable level that would be
easy to understand, for English students and foreign ones alike. We have also
provided several examples and solutions so that understanding would be even
more efficient. In writing this book, we have tried to write at a level that
would be easy to be understood by native and non-native English speaking
students. And that helps them pay more attention to the lecturer, which in
turn, increases their understanding.
And to enrich the subject even more, a couple of new ways have been
accomplished by the authors and they have been added into this book in

I
several chapters. We hope that this book will be able to help students in this
magnificent portion of the field of Mathematics and its vast array of
applications, and provide a paved pathway to encourage them to learn more
about the subject.

Authors, 2015

II
 ACKNOWLEDGMENTS

We would like to express our appreciation to Faculty of Science and

Science Education of University of Sulaimani and College of Science of
University of Salahaddin/Erbil, for volunteering to use a preliminary version
of this text. We also wish to acknowledge the valuable input from students
who used this book. A deeply felt thank you goes to the following reviewers
for their words of encouragement, criticisms, and thoughtful suggestions:
We would like to thank Professor Dr. Fadhil Hameed Easif and
assistance Professor Dr. Shazad Shawqi Ahmed Scientific evaluation and
Dr.Bekhal Latif Muhedeen for languages evaluation and their feedback on
this book.
Finally, we thank the editorial and production staff, especially Professor
Dr. Hamid Majid Ahmed head of the Central Committee for books approving
and publishing at Sulaimani University for invaluable help, comments and
proving in preparation of the book.

Authors
2015

III
 CONTENTS

Preface I

ACKNOWLEDGMENTS III

Chapter 1: Basic Concepts and Computer Arithmetic 1-19

1.1 Introduction 1
1.2 Some Basic Concepts 1
1.2.1 Taylor Series for Functions of a Single Variable 1
1.2.2. Infinitely Differentiable Functions 3
1.2.3Mean Value Theorem 4
1.2.4 Rolles Theorem 4
1.2.5 Intermediate Value Theorem 4
1.2.6 Differentiable Functions 4
1.3 Computer Arithmetic 5
1.3.1 Floating-Point Number 5
1.3.2 The Representation of Fractions 7
1.3.3 Sources of Error 7
1.3.4 Errors of Numerical Approximations 8
1.3.4.1 Truncation Errors 9
1.3.4.2 Rounding and Chopped Error 9
1.3.4.3 Round-of Errors 10
1.3.4.4 Inherent Error 11
1.4 Measuring Errors 11
1.4.1 True and Relative Errors 11
1.4.2 Approximate Error and Relative Approximate Error 13
1.5 Numerical Instability 15
1.6 Big O and Small o Notation 16
EXERCISES 1 18

IV
Chapter2: Solutions of Equations in one Variable 20-74
2.1 Introduction 20
2.2 Locating the Oosition of Roots (Programming Method) 20
2.3 Numerical Methods 22
2.3.1 Bisection Method 22
2.3.2 False position method(Regula Falsi Method) 27
2.3.3 Secant Method 29
2.3.4 Newton-Raphson Method 33
2.3.5 Chybeshev method 40
2.3.6 Fixed Point Method 41
2.3.7 Aitkin Method 49
2.3.8 Mller's Method 50
2.3.9 Horner Algorithm 53
2.3.10 Bairstow's Method 56
2.3.11 Rostam-Kawa Methods 60
2.3.12 Rostam-Shno Methods 67
Exercises 2 71
Chapter 3: Solving linear System of Equations 75-113
3.1 Introduction 75
3.2 Direct Method 75
3.2.1 Gauss Elimination 76
3.2.2 Gauss Elimination with Partial Pivoting 79
3.2.3 LU Factorization Method (Doolittle factorization) 80
3.2.4 Cholesky Factorization 84
3.3 Norms of Vectors and Matrices 86
3.4 Indirect method (or Iterative methods) 100
3.4.1. Jacobi Method 101
3.4.2.Gauss-Seidel Method 107

V
Exercises 3 112
Chapter 4: Solving System of Non-Linear Equations 114-125
4.1 Introduction 114
4.2 Numerical Methods 114
4.2.1 Fixed-Point Iteration 114
4.2.2 Newton-Raphson Method 119
4.2.3 Modified Newton-Raphson Method 123
Exercise 4 125
Chapter 5: Interpolation and Numerical Differentiation 126-177
5.1 Introduction 126
5.2 The Finite Difference Calculus 126
5.2.1. Shifting Operator (E) 127
5.2.2. Forward Difference Operator () 127
5.2.3. Backward Difference Operator () 130
5.2.4. Central Deference Operator () 130
5.2.5.Average Operator () 131
5.2.6 Divided Difference Operator () 132
5.3 Interpolation 133
5.3.1Interpolation Problem 134
5.3.1.1 Lagrange Interpolation Polynomial 134
5.3.1.2 Divided Difference Interpolation Formula 140
5.4 Interpolation at Equally spaced nodes 145
5.4.1 Newton Forward Differences Interpolation Formula 145
5.4.2 Newton Backward Differences Interpolation Formula 149
5.4.3 Bessels Interpolation Formula 151
5.5 Inverse Interpolation 153
5.6 Numerical Differentiation 155
5.6.1 Differentiation of Continuous Functions 155

VI
 5.6.2 Forward Difference Approximation of the First Derivative 156

5.6.3 Backward Difference Approximation of the First Derivative 158

5.6.4 Forward Difference Approximation from Taylor Series 160

5.6.5 Finite Difference Approximation of Higher Derivatives 164

5.6.6 Differentiation of Discrete Functions 167

Exercises 5 173

Chapter 6: Spline Approximations 178-206

6.1 Introduction 178

6.2 Interpolation by Spline Function 178
6.2.1Fist Degree Spline 179
6.2.2 Spline of Degree two (Quadratic Spline) 181
6.2.3 Natural Cubic Spline 184
6.3 Lacunary Interpolation by Splines Function 189
6.3.1 Quintic Spline 190
6.3.2 Sixth Degree Spline 192
6.3.3 Seventh Degree Spline 202
6.3.4 Ninth Degree Spline Function 204
Exercises 6 206
Chapter 7: Least square and Curve fitting 207-241
7.1 Introduction 207
7.2 linear Least Square 207
7.3 Nonlinear Least Square 219
7.3.1 Exponential Model 219
7.3.2 Growth Model 224
7.3.3 Polynomial Models 227
7.4. Transforming the Data to use Linear Least Square Formulas 230
7.4.1 Exponential Model 230

VII
 7.4.2 Logarithmic Functions 233
7.4.3 Power Functions 235
7.4.4 Growth Model 238
Exercises 7 239
Chapter 8: Numerical Integrations 242-300
8.1 Introduction 242
8.2 Trapezoidal Rule of Integration 242
8.2.1 Derivation of the Trapezoidal Rule 244
8.2.2 Multiple-Segment Trapezoidal Rule 248
8.2.3 Error in Multiple-segment Trapezoidal Rule 254
8.3 Simpsons 1/3 Rule 256
8.3.1: Error in Multiple-Segment Simpsons 1/3 rule 263
8.4 Simpson 3/8 Rule for Integration 264
8.5 Richardsons Extrapolation Formula for Trapezoidal Rule 269
8.6 Romberg Integration 271
8.7 Gauss Quadrature Rule of Integration 276
8.7.1 Derivation of two-Point Gauss Quadrature Rule 277
8.7.2 Higher Point Gauss Quadrature Formulas 280
8.7.3 Arguments and Weighing Factors for n-Point Gauss Quadrature Rules
281
8.8 Gauss Legendre Integration Methods 290
8.9 Gauss-Chebyshev Integration Methods 294
8.10 Gauss-Hermite Integration Methods 296
Exercises 8 299
Chapter 9: Numerical Solutions of Ordinary Differential Equations 301-353
9.1 Introduction 301
9.2 Eulers Method for Ordinary Differential Equations 301
9.2.1 Derivation of Eulers Method 302
9.3 Modified Euler Method 309

VIII
 9.4 Taylors Series Method 310
9.5 Runge-Kutta 2nd Order Method 312
9.5.1 Runge-Kutta 2nd Order Method 313
9.5.2 Runge-Kutta 4th Order Method 318
9.6 Finite Difference Method 324
9.7 Shooting Method 338
9.8 Predictor-Corrector Methods 345
9.8.1 Adams-Moulton Predictor-Corrector Method 345
Exercises 9 351
Chapter 10: Solving Higher Order Ordinary Differential Equations 354-369
10.1 Eulers and Runge-Kutta methods for Higher Order Ordinary Differential
Equations (ODEs) 354
10.2 Lacunary Interpolation Methods for Higher order ODEs 359
10.2.1 Ninth Degree Spline Method for Solving System of ODEs 359
10.2.2 Fifth Degree Spline Method for Solving Initial Value Problems 365
Bibliography 370
Index 374

IX

View publication stats