You are on page 1of 13

Some basics

Regression analysis
In statistical modeling, regression analysis is a set of statistical processes for estimating the relationships
among variables. It includes many techniques for modeling and analyzing several variables, when the focus is
on the relationship between a dependent variable and one or more independent variables.

Linear regression
In statistics, linear regression is a linear approach to modelling the relationship between a scalar response (or
dependent variable) and one or more explanatory variables (or independent variables). The case of one
explanatory variable is called simple linear regression.

A linear regression line/slop line/ trend line

A linear regression line has an equation of the form Y = a + bX, where X is the explanatory variable and Y is
the dependent variable. The slope of the line is b, and a is the intercept (the value of y when x = 0).
Correlation is a technique used to quantify the associations between two continuous variables called
the response or dependent variable and predictors, or explanatory or independent variables.

The word correlation is used in everyday life to denote some form of association. We might say that we have
noticed a correlation between age and weight. However, in statistical terms we use correlation to denote
association between two quantitative variables. We also assume that the association is linear, that one
variable increases or decreases a fixed amount for a unit increase or decrease in the other. The other
technique that is often used in these circumstances is regression, which involves estimating the best straight
line to summarise the association.
Correlation coefficient/Regression Coefficient
The Correlation coefficient or Regression Coefficient is the degree of association is denoted by r. It is
sometimes called Pearson's correlation coefficient after its originator and is a measure of linear association. If
a curved line is needed to express the relationship, other and more complicated measures of the correlation
must be used. The correlation coefficient is measured on a scale that varies from + 1 through 0 to - 1.
Complete correlation the correlation between two variables is expressed by either + 1 or -1. When one
variable increases as the other increases is positive; when one decreases as the other increases it is negative.
Complete absence of correlation is represented by 0.

Constant 'b' in the regression equation that tells about the change in the value of dependent variable
corresponding to the unit change in the independent variable.
How to find the regression line by Hand
How to calculate linear regression using least square method