Foundations of Data

Science
Module 05 - Linear Algebra
Module Objectives
At the end of this module you will be able to:

● Understand the introduction, history and the applications of linear algebra.

● Understand and apply the important notations in linear algebra.
● Describe the important concepts of linear algebra:
○ Scalars
○ Vectors
○ Vector spaces
○ Basis
○ Matrices
● Understand the important definitions on linear system of equations.
Module Topics
Let us take a quick look at the topics we will cover in this module:
● Introduction to Linear Algebra
● Notations in Linear Algebra
● Important Concepts of Linear Algebra
● Definitions of Linear Algebra
1.1 Introduction to Linear Algebra
Linear Algebra:

● The branch of mathematics that involves the

study of vector spaces and the linear
transformations between them.
● It involves the study of linear equations and
linear functions and their representation
through matrices and vector spaces.
● To be precise, Linear algebra is the study of
vectors and linear structures.
● Initial use cases were solving systems of
linear equations.
1.2 History of Linear Algebra
The following timelines illustrate the history of Linear Algebra:

● 4000 years ago - Babylonians - Solving simple 2X2 system of linear equations with two
unknowns
● 200 BC - Chinese - Solution for the 3X3 system of equations
● 1693 - Determinants by Leibniz (who discovered calculus)
● 1750 - Cramer rule by Cramer - Introduction to the analysis of algebraic curves
● 1776 - Euler - Euler’s theorem
● 1811 - Gauss - Method of least squares; Gaussian elimination
● 1848 - JJ Sylvester - Introduced the term ‘matrix’ for an array of numbers
● 1855 - Arthur Cayley - Matrix multiplication - Identity matrix and Inverse of a square
matrix
1.3 Applications of Linear Algebra

Some of the disciplines where Applications of Linear Algebra:

Linear algebra is applied: ● Oil exploration
● Mathematics ● Electrical networks
● Engineering ● Linear Programming
● Computer Science ● Aircraft design
● Physics ● Space flight and control systems
● Biology ● GPS navigation
● Economics ● Multichannel image processing
● Statistics ● Computer graphics
What did You Grasp?
Who introduced the method of least squares?

a. Euler
b. Cramer
c. Gauss
d. JJ Sylvester
2.1 Linear Algebra Notations
Important notations of linear algebra are listed in the table below.
2.1 Linear Algebra Notations (Contd..)
Important notations of linear algebra are listed in the table below.
 2.1 Linear Algebra Notations (Contd…)
Important notations of linear algebra are listed in the table below.
 2.1 Linear Algebra Notations (Contd…)
Important notations of linear algebra are listed in the table below.
What did You Grasp?
Which of the following options is a correct notation for a vector space?

a. V
b. v
c. V
d. None of the above
3.1 Scalars
Scalars:

● A single number or an element of a field, which forms the basis of a vector

space.
● Refer to real numbers or other elements of a field.
● Have magnitude only, but not direction.
● Are denoted by lowercase italics.
● The kind or number of scalars is specified when scalars are introduced.
 3.2 Vectors
Vectors:

● Are arrays of objects, which have magnitude and

direction.
● Are not only stacks of numbers, but they also include, but
not limited to polynomials, power series, functions, etc.
● Should be added if these are of the same kind.
● Are things that you can add and scalar multiply.

A very special vector can be produced from any vector of any

kind by scalar multiplying any vector by the number 0. This is
called the zero vector.
3.3 Vector Spaces
A vector space is a set that is closed under addition and scalar multiplication and
is denoted as V.
3.4 Basis
● A basis for a vector space is a sequence of vectors that is linearly
independent and that spans the space.
● For any ,

is the standard (or natural) basis, and we denote these vectors,

● In any vector space, a subset is a basis, if and only if each vector in the space
can be expressed as a linear combination of elements of the subset in one
and only one way.
3.5 Matrices
● A matrix, like a vector, is an array of numbers, the difference is that matrix is
an organized table of numbers instead of just being a list.
● Suppose that m and n are positive integers. An m x n matrix is a rectangular
array of numbers with m rows and n columns. Matrices are usually denoted
by capital letters.
● For example:

is a 5 x 4 matrix.
What did You Grasp?
1. State True or False.

Velocity of wind is a scalar.

a. True
b. False
What did You Grasp?
2. State True or False.

A basis has set of vectors that are linearly dependent.

a. True
b. False
4.1 Definitions on Linear Equations
1. A linear equation in the variables x1, x2, …. xn is an equation of the form

a1x1 + a2x2 + ……. + anxn = b,

where a1, a2, …. an and b are real or complex numbers (that are often given in
advance).

2. If m and n are positive integers, a system of linear equations in the variables x1, x2,
……. xn is a set of equations of the form

where aij (i = 1, …. m, j = 1, …. n) and bi (i = 1, ….. m) are real or complex numbers

(that are often given in advance). This system of linear equations is said to consist of
m equations with n unknowns.
4.1 Definitions on Linear Equations (Contd…)
3. The solution set of a system of linear equations is the set of all solutions of the
system.

4. Two linear systems are said to be equivalent to each other if they have the
same solution set.

5. A linear system is said to be consistent if it has at least one solution and is

otherwise said to be inconsistent.
What did You Grasp?
When do two linear systems become equivalent?

a. When they have unknowns.

b. If they have the same solution set.
c. If they have real numbers as solution.
d. None of the above.
In a Nutshell
In this module, you have learnt:

● The introduction, history and applications of Linear algebra.

● The important notations of Linear algebra.
● Important concepts in Linear algebra:
○ Scalars
○ Vectors
○ Vector spaces
○ Basis
○ Matrices
● Important definitions on linear system of equations.