Beruflich Dokumente
Kultur Dokumente
y = β0 + β1x +ε
where:
β0 and β1 are called parameters of the model,
ε is a random variable called the error term.
Simple Linear Regression Equation
E(y) = β0 + β1x
E(y)
Regression line
Intercept Slope β1
β0 is positive
x
Simple Linear Regression Equation
E(y)
Intercept
β0 Regression line
Slope β1
is negative
x
Simple Linear Regression Equation
n No Relationship
E(y)
x
Estimated Simple Linear Regression Equation
ŷ = b0 + b1 x
where:
yi = observed value of the dependent variable
for the ith observation
y^i = estimated value of the dependent variable
for the ith observation
Least Squares Method
• Slope for the Estimated Regression Equation
b1 = ∑ ( x − x )( y − y )
i i
∑ (x − x )
i
2
where:
xi = value of independent variable for ith
observation
yi = value of dependent variable for ith
_ observation
x = mean value for independent variable
_
y = mean value for dependent variable
Least Squares Method
b0 = y − b1 x
Simple Linear Regression
Number of Number of
TV Ads (x) Cars Sold (y)
1 14
3 24
2 18
1 17
3 27
Σx = 10 Σy = 100
x=2 y = 20
Estimated Regression Equation
n Slope for the Estimated Regression Equation
b1 = ∑ ( x i − x )( y i − y ) 20
= =5
∑ ( xi − x ) 2
4
20
y = 5x + 10
15
10
5
0
0 1 2 3 4
TV Ads
Coefficient of Determination
• Relationship Among SST, SSR, SSE
SST = SSR + SSE
∑ i
( y − y )2
= ∑ i
( ˆ
y − y )2
+ ∑ i i
( y − ˆ
y )2
where:
SST = total sum of squares
SSR = sum of squares due to regression
SSE = sum of squares due to error
Coefficient of Determination
r2 = SSR/SST
where:
SSR = sum of squares due to regression
SST = total sum of squares
Coefficient of Determination
where:
b1 = the slope of the estimated regression
equation yˆ = b0 + b1 x
Sample Correlation Coefficient
rxy = (sign of b1 ) r 2
rxy = + .8772
rxy = +.9366
Assumptions About the Error
Term ε
The error ε is a random variable with mean of zero.
s 2 = MSE = SSE/(n − 2)
where:
SSE = ∑ ( yi − yˆ i ) 2 = ∑ ( yi − b0 − b1 xi ) 2
Testing for Significance
• An Estimate of σ
• To estimate σ we take the square root of σ 2.
• The resulting s is called the standard error of
the estimate.
SSE
s = MSE =
n−2
Testing for Significance: t Test
• Hypotheses
H0 : β1 = 0
Ha : β1 ≠ 0
• Test Statistic
b1 s
t= where sb1 =
sb1 2
Σ( xi − x )
Testing for Significance: t Test
n Rejection Rule
where:
tα/2 is based on a t distribution
with n - 2 degrees of freedom
Source
• ASW