Psychology3500StatisticsandResearchDesign

ANSWERKEY
Assignment#5,dueWed7November2012

Answerthefollowingquestions.Ideally,typeyouranswersintothewordprocessordocument;to
createfigures,eitherusesoftwarelikeRorExceltocreateafigureorsketchitandscanthepage.Turn
inyourassignmentinBOTHoftheseTWOWAYS:[1]uploaditasasinglefile(ideallyPDFbutword
processorformatsarealsoaccepted)usingtheBlackboardTurnItInitemunderAssignmentsin
Blackboard,usingthefilenamenetid_Assignment5.pdfwherenetidisyourNetID.(Ifyoudisorganizemy
effortstogradeefficientlybynotnamingyourfileinthiswaythenyouwilllosepointsandmakeme
sad).[2]PrintoutyourcompletedassignmentandturninthishardcopyattheSTARTofclassonthe
duedate.Pleasewriteyournameoneveryphysicalpageincasetheyareseparatedduringgrading.

>>YOUMUSTSHOWYOURWORKINALLNUMERICALPROBLEMS!<<

(1) Apsychologistisinterestedintheeffectofauditorydistractorsonperformanceinhandeye
coordinationtasks.Shegathersagroupofsubjectsandrandomlydividesthemintofourgroups.All
ofthesubjectsthenplayavideogamerequiringsubstantialongoinghandeyecoordination.The
gameinternallyscoresthesubjectshandeyecoordinationperformancebutdoesnotadjustits
difficultybasedonsubjectperformance.Attheendofthetestingperiod,thesoftwareproducesan
overallhandeyecoordinationscoreforthatsubjectwhichisloggedbythepsychologistasdata.Of
thefourgroups,GroupAplaysthegameinsilence,GroupBplaysthegamewithappropriatesound
effectsthatareappropriatelytimed,GroupCplayswithsimilarlyappropriatesoundeffectsexcept
thattheyareasynchronouslytimedwithrespecttothevideo(thatis,thesoundscomeatthewrong
timeswithrespecttothevideo).GroupDplaysthegamewithanentirelyunrelatedsoundtrack
(thatis,noneofthesoundsinthesoundtrackarerelatedtoanythinggoingoninthevideo).

Howshouldyouanalyzethesedatainordertodeterminewhich,ifany,ofthesetreatmentsaffect
handeyecoordination?Thatis,whichstatisticaltest(s)shouldyouuse,andwhy?Identifythe
factor(s)/independentvariable(s),its/theirlevels,andthedependentvariable.Provideenough
detailsothatitisclearthatyouknowwhatyouaretalkingabout.Youmayassumehomogeneityof
variance,andthatthesamplesizeislargeenoughtoassumenormalityofthedistributionofsample
means.

First,useaonewayindependentmeasuresANOVAtodeterminewhetherthereisanyeffectof
group(i.e.,ofauditorydistractortype).Thereisonefactor(typeofauditorydistractor)with
fourlevels(associatedwithgroupsA,B,C,andD).Thedependentvariableistheoverallhand
eyecoordinationscoreproducedforeachsubjectbythesoftware.

Ifthereisasignificanteffectofgroup,thenperformpairwiseposthocteststodeterminewhich
groupsexhibitsignificantlydifferentcoordinationscoresfromwhichothergroups.Options
includetheTukeyHSDtest,theScheffetest,orevenasetofttestsifandonlyifmultiple
comparisonscorrectionssuchasBonferronicorrectionsaremade.

(2) Bodgerslovegrumkinpaste,butitisbelievedtonotbehealthyforthemtoeatregularly.Others
claimthatgrumkinpasteisanexcellentdietforanactivebodger,andthattheirhealthprimarily
dependsonwhetherthebodgersgetenoughexercise.Totestthis,abodgerkeeperwhoisalsoa
competentstatisticiansetsupastudyasfollows.Agroupofbodgersisdividedrandomlyintofour
groups.Onegroupisfedgrumkinpasteandexercisedvigorouslyeverydayinthebodgerpool.A
secondgroupisfedgrumkinpastebutnotexercised.Athirdgroupisfedhealthybodgerchowand
alsoexercisedvigorously.Thefourthgroupisfedhealthybodgerchowbutisnotexercised.After
thisroutineiscontinuedforsixweeks,thehealthofeachbodgerisassessedandrecordedasa
singlescorebyaqualifiedbodgerveterinarian.

Howshouldyouanalyzethesedatainordertodeterminewhich,ifany,ofthesetreatmentsaffect
bodgerhealth?Thatis,whichstatisticaltest(s)shouldyouuse,andwhy?Identifythe
factor(s)/independentvariable(s),its/theirlevels,andthedependentvariable.Provideenough
detailsothatitisclearthatyouknowwhatyouaretalkingabout.Youmayassumehomogeneityof
variance,andthatthesamplesizeislargeenoughtoassumenormalityofthedistributionofsample
means.

First,useatwowayindependentmeasuresANOVAtodeterminewhetherthereisanyeffectof
diet(grumkinpasteorbodgerchow),ofexercise,oraninteractionbetweenthetwo.

Therearetwofactors(dietandexerciselevel).Eachhastwolevels(diet:grumkinpasteor
bodgerchow;exerciselevel:noneorlots).Thedependentvariableistheoverallbodgerhealth
scoreproducedforeachsubjectbytheveterinarian.

Noposthoctestsarenecessary.Becausethereareonlytwolevelsforeachfactor,theANOVA
resultstellyoueverythingthatyouneedtoknow.

(3) Youareprovidedwiththefollowingsetofdatafromarepeatedmeasuresstudyconductedbythe
AcmeJavelinCo.toassesswhetherornoteitheroftwonewlydesignedjavelinstravelsfartherthan
traditionaljavelinswhenthrown.Theexperimentwascounterbalancedsuchthatdifferentsubjects
allthreweachoneofthethreejavelinsbutindifferentorders,asfollows:

33.3%ofsubjects:javelinthrowingorder=traditional,newdesignA,newdesignB
33.3%ofsubjects:javelinthrowingorder=newdesignA,newdesignB,traditional
33.3%ofsubjects:javelinthrowingorder=newdesignB,traditional,newdesignA

Metersthrown
Subject#
1
2
3
4

Traditional
42.3
39.1
40.8
49.2

DesignA
42.4
39.5
47.9
52.1

DesignB
39.5
37.8
37.9
41.7

5
6
7
8

51.1
46.6
39.3
41.1

51.1
41.9
40.4
43.5

50.1
41.8
36.2
39.5

(a) Performthefullanalysisofvarianceonthisdataset,showingyourcalculationsandtheANOVA
summarytable,andalsoreportthefinalresultinstandardformatincludingeffectsize.Let
alpha=0.05.Youmayassumehomogeneityofvariance(calledsphericityinRMANOVA),and
normalityofthedistributionofsamplemeans.Hint:thecorrectFstatisticis7.63.(Because
youareusingtablesyoucannotbeexpectedtogenerateanexactpvalue;justshowthatp<).

Fstatistic=MS(bt)/MS(err)=39.33/5.16=7.63
Fcrit(2,14,alpha=0.05)=3.74

Effectsize(etasquared):
=SS(bt)/[SS(bt)+SS(err)]
=78.67/(78.67+72.19)
=0.521

AnswerinStandardFormat:

F(2,14)=7.33,p<0.05,=0.521.

(b) UseTukeyshonestlysignificantdifferenttesttodeterminewhichofthethreejavelinsperforms
significantlydifferentlyfromanother.Reportyourfindingsandshowyourwork.

(c) Whatpercentageofthetotalvarianceinthisdatasetcanbeattributedtotherealdifferences
amongjavelintypes?

Thisiswhattheeffectsizeetasquaredmeans,sotheanswerisjustthepercentageversionof
etasquared:52.1%

(d) InregularEnglish,basedontheseresults,whatwouldyoutelltheAcmecompanyabouttheir
newjavelindesigns?

Neithernewdesignisbetterthanthetraditionaljavelindesign.Infact,newdesignBis
significantlyworsethanthetraditionaldesign(andalsoworsethannewdesignA).Newdesign
Aperformsaboutthesameasthetraditionaljavelindesign(asidefromsamplingerror).

Itisnotcorrect,orOK,tosaythatdesignAperformsbetterthanthetraditionaljavelin
althoughnotsignificantlyso.Thatiscauseforstatisticalsmackdown.

(e) Whatwouldbeapossibleconfoundwiththeinterpretationoftheseresultsiftheexperimental
designhadnotbeenproperlycounterbalancedasdescribedabove(say,ifallsubjectshad
thrownthetraditionaljavelinfirst,thendesignA,andfinallydesignB)?
4


Ifalljavelinshadbeenthrowninthesameorderbyallsubjects,onecouldnotdistinguishany
possibleeffectsofjavelindesignfrompossibleeffectsbasedontheorderofthrowing.Order
ofthrowingeffectscouldinclude,forexample,aneffectofpractice(iflaterthrowswere
better)orfatigue(iflaterthrowswereworse).

(4) Forthefollowingsetofscores:

Groups

GroupA
177.5
173.7
172.2

GroupB
182.5
176.6
184.5

GroupC
175.8
169.5
175.9

GroupD
172.1
171.0
171.4

180.5
182.2
180.4
171.0
173.3

189.2
188.5
181.9
176.8
180.8

178.7
181.8
175.6
168.9
174.9

173.5
184.4
175.6
170.4
174.2

(a) PerformanindependentmeasuresANOVAonthesedata.Youmayassumenormalityand
homogeneityofvariance.Letalpha=0.01.Showyourwork,andincludeanANOVAsummary
table.Hint:thecorrectFstatisticresultis5.85.Reportyourresultsinstandardformat
includingeffectsize.

Fstatistic=MS(bt)/MS(wt)=116.80/19.97=5.85
Fcrit(3,28,alpha=0.01)=4.57

Effectsize(etasquared):
=SS(bt)/SS(tot)
=350.40/909.46
=0.385

AnswerinStandardFormat:

F(3,28)=5.85,p<0.01,=0.385.

(b) UseTukeyHSDteststodemonstratewhichlevelsofthefactoraresignificantlydifferentfrom
oneanother,andreporttheresults.Note:itisconservativetopickthelargervalueofqfroma
tableiftheexactvalueisnotavailable.

Note:Useddf=24onstudentizedrangestatistictablebecausedf=28isnotavailable(df=24is
theconservativechoicebecauseitmakestheHSDthresholdhigher).

Note:AvsBandBvsCwouldbesignificantifalpha=0.05(HSD=6.16inthatcase).However,
alpha=0.01becausethatiswhatitwasfortheoriginalANOVA.

(c) InregularEnglish,brieflydescribe/summarizetheresultsofyouranalysis(thatis:istherea
difference,andwhatis/arethatdifference/thosedifferences?).

Therewasaneffectoftreatment.Uponfurtheranalysis,onlygroupsBandDweresignificantly
differentfromoneanotheratthealpha=0.01level.

(5) Youareaskedtoanalyzethefollowingdataset,comparingthedurabilityofthreepossiblewidget
materialsunderhighstressandlowstressusagescenarios.Thankfully,yourwiseandcompetent
assistanthasalreadycalculatedseveralofthedescriptivestatisticsforeachgroupofscores,
includingX2.

Highstress

Lowstress

WidgetMaterial
Bronze
Zinc
Steel
n
5
5
5
T
5.0
5.0
20.0
SS
n
T
SS

15.0
5
5.0
15.0

15.0
5
15.0
25.0

25.0
5
40.0
25.0

X2=580.0

(a) PerformatwowayindependentmeasuresANOVAonthesedata.Youmayassumenormality
andhomogeneityofvariance.Letalpha=0.05.Showyourwork,andincludeanANOVA
summarytable.Hint:thecorrectFstatisticsare14.0,6.0,and2.0(notspecifyingwhichis
which).Reportyourresultsforeachfactor/interactioninstandardformatincludingeffectsizes.

Fcrit(1,24)foralpha=0.05is4.26...appliestomaineffectofstress
Fcrit(2,24)foralpha=0.05is3.40...appliestomaineffectofmaterialandtheinteraction

Answersinstandardformat:

Maineffectofmaterial:F(2,24)=14.0,p<0.05,=0.538.
Maineffectofstress:F(1,24)=6.0,p<0.05,=0.200.
InteractionbetweenmaterialXstress:F(2,24)=2.0,p>0.05.

Thereshouldbenocalculatedfortheinteraction,becausethereisnosignificanteffect.

(b) InplainEnglish,stateyourconclusionsaboutthedurabilityofwidgetsunderhighandlow
stressconditionsasifyouwerereportingtothosewhoaskedyoutoanalyzethesedata.Beas
completeaspossible(giventhatyouwerenotaskedtoperformanyposthoctests).Becareful
nottostateanyconclusionsthatarenotjustified(i.e.,thatmightrequireposthoctestingto
assess).

Thesedatashowthatthereisasignificantdifferenceamongmaterials.Steelisthemost
durableunderbothhighandlowstresssituations,thoughwedidnotdopairwisetestingto
ensurethatsteelissignificantlybetterthantheothermetals.

Thedatashowthatthereisasignificanteffectofstress.Higherstressreducesmaterial
durabilityingeneral.

Nointeractionwasobserved.Hence,thereisnoevidencetosupportthehypothesisthatthe
threemetalsaredifferentlysensitivetostress,orthatstressaffectsthedurabilityofdifferent
metalsdifferently.