Beruflich Dokumente
Kultur Dokumente
RIT Podium
Usability Preliminary Data Analysis
GoudamMuralitharan
HuangYi
HuangZiyan
Page2of39
Table of Contents
ExecutiveSummary
Purpose
Studyquestions
PilotTest
Process
Results
Changes
ExperimentalDesign
Method(testdesign)
Sessionoutlineandtiming
Participants
Recruitment
Demographics
DataAnalysis
Recommendations
Appendix
Page3of39
Executive Summary
This report documentsthefindingsofausabilitytestoftheRITpodiuminterfacecarriedoutin
April2015byourgroup.Themainpurposeof thetest wastoassesstheusabilityandfirstuse
intuitivenessofthepodiuminterfacefornewandlessfrequentusers.
PositiveaspectsaboutRITPodiuminterface:
Advanced functionalitiesincluding, but notlimitedto,controllingtwoprojectorscreens,
manipulating different input sources like document camera, HDMI, etc from one
touchbasedinterface.
PeninputbasedPCtointeractwiththematerialsdisplayedonscreen.
ImprovementareasforRITPodiuminterface:
Adherence to Normans design principles Feedback, Discoverability, Mapping and
Visibility of system state. In certain scenarios, participants found it hard to locate the
required functionalities to perform certain operations. In other scenarios, they were
confounded by the functions and its physical relevance to the objects around the
classroom. There was also a lack of immediatefeedback when the display states are
switchedfromontooffandviceversa.
Basedontheusabilityproblemsidentifiedinthistest,werecommend:
Modifications to the design elements behind the panel interface to incorporate the
aforementioneddesignprinciples
Page4of39
Purpose
We will conduct a usability testing study to assess the overall effectiveness of RIT
Podiuminterface.Thefollowingaretheobjectivesofthisstudy:
1. Assess the overall effectiveness of the RIT Podium interface, for users with
different degree of familiarity to the system, performing basic and common
presentingtasks.
Page5of39
Study questions
1. How easily can the users understand the symbols and icons? Which ones are
problematic?Why?
2. Howeasilyandquicklycanusersgetstartedtoperformthebasictasks?
3. What obstacles prevent users from completing the setup activities before
presentation?
4. How easily can users set up the input sources and adjust the settings to their
needs?
5. What questionsdousersaskastheyworkthroughthesourcesetuptaskandthe
tasksfollowingthat?
6. Can the users use the advanced functionalities of thecontrolpanelwithoutany
assistanceorpriortraining?
7. Howquicklyandeasilycantheusersswitchbetweendifferentmodes?
8. Dotheusersfaceanydifficultiesduringthepresentation?Ifyes,whatarethey?
9. Is theresponse timeafterone operation the main reason of user frustrationand
subsequenterroroperations?
10. How do the users react when the systemworksin an unexpectedmannerafter
theyperformedausual,systemsupportedoperation?
Page6of39
Pilot Test
Process
For the pilot test, we followed the initial test plan.Theparticipantwasscheduledfor6thApril,
2015 in the RIT LOW 121135 classroom, where the podium interface is available. One
member of the team acted as theteammoderator,oneactedasthenotetaker,andtheother
memberwasthematerialsmanager.Thepilottookaround60minutesintotal.
Results
The pilot test proceeded as expected with no hiccups. The participantand theoveralltesting
procedure helpedus gain testing experience, andidentify the minor changesrequiredbefore
theactualusabilitytesting.
Changes
We made changes to the tasks, their description, and the order in which they will be
presented to the user. Some minor changes were made to the questionnaire, and better
strategiesweredevelopedformaterialacquisitionandsettingsadjustments.
Page7of39
Experimental Design
Method (test design)
We will use a within
subjects design for the study. In this within
subjects study, each
participant will work through all the taskslisted in thetask list. We will conduct up to 6
individual 60
minute usability study sessions. Each participant will perform all of the 6
major task paths using RIT Podium interface. Welluse20minutes ofeachsessionto
explain the session to the participant, review their background information, and then
conduct a post
test debriefing interview. During the middle 40 minutes ofthe session,
participantswill workonsettingupthepresentationbytryingdifferentinputsourcesand
workingtheirwayaroundtheRITpodiuminterface.
Activity
Time(1hourtotal)
Introductiontothesession
5minutes
Backgroundinterview
5minutes
Tasks
40minutes
Posttestdebriefing
10minutes
Introductiontothesession(5minutes)
Discuss:
Purposeofthestudy.
Importanceoftheirinvolvementinthestudy.
Moderatorsrole.
Roomconfiguration,recordingsystems,observers,etc.
Page8of39
Theprotocolfortherestofthesession.
Thinkingaloud.
Filloutabackgroundquestionnaireandpre
testquestionnaire.
Tasks(40minutes)
Participants will begin with one of the four DPA and will be given a set of tasks to
complete. Three tasks will be given one after the other andthe beginningtaskwill be
determinedbythecounter
balancingtechnique.
Post
testdebriefing(10minutes)
Giveparticipantpost
testcomparisonquestionnaire.
Askbroadquestionstocollectpreferenceandotherqualitativedata.
Followuponanyparticularproblemsthatcameupfortheparticipant.
Page9of39
Participants
Recruitment
There were 30 flyers postedin differentbuildings at Rochester Institute ofTechnology,
which include GOL, GLE, BOO, GAN, WAL, SAU, GOS and LOW. Participants were
selectedbasedontheirresponsestothescreenerquestionnaire.
Atotalof10participantswereshortlistedforthetestaftertheselectionprocess.
Demographics
TheselectedparticipantswereallstudentsofRochesterInstituteofTechnology.The
ageoftheparticipantsarerepresentedintheFigure1.Alltheparticipantswerethe
agesbetween21and30.
Figure1AgeDistribution
GenderofparticipantswasdistributedasdepictedinFigure2.Malesandfemalesare
equallydistributed.Halfparticipantswasmale,andtheotherhalfwasfemale.
Page10of39
Figure2Genderdistribution
Alloftheparticipantshaveatleastacollegedegree,asdepictedinFigure3.
Figure3Academicleveldistribution
Participantshavedifferentkindofmajor,mostofthemarefromtheEngineering
domain,asshowingintheFigure4.
Page11of39
Figure4MajorDistribution
Intermofpresentationfrequency,theparticipantsatleastgivepresentation12timesa
semester(seeFigure5).
Page12of39
Figure5.FrequencyofPresentation
Page13of39
Data Analysis
Data from pre-test questionnaire
Aslightsneakpeekintotheinitialexperiencesofthemixoftheparticipantsofourstudy
areasfollows:
Figure6.Thepercentageofmodetheparticipantsused
Page14of39
Figure7.Theconnectmethodparticipantfrequentlyuse
Therearestillsomepeoplecouldnotdifferentiatedifferentport.(inthesuggestion:
probably,thepodiumcouldrecognizewhichportiscurrentlyused,andfreezeother
sourceswhicharenotconnected(notfreezethesourcewhichdonotneedtoconnect
forexampletheDocCam).
Page15of39
Figure8.Thepercentageofthepreferedinterfaceuseonpodium
Figure9.Thepercentageoftheproblemtheparticipantsmeetwhenconnecttheprojector
Page16of39
Insummary,Mostparticipantsreliedonthepowerpointfortheirpresentation.40%
participantsexpectcontrollingeverythingfromtheirlaptop,ratherthanfromtheexternal
device.AswecouldseefromtheFigure9,only10%participantshavetroublethe
traditionalpodiuminterface.Mostparticipantsonlygotproblemslikematchinginputport
orwaitingforwarmingup.
Tasks
No.
TaskDescription
Number
of
Issues
Average
Time
Required
#1
235
#2
Nowyouaresurethatslidescouldcorrectlyshowonthe
screen.Theclassbeginandprofessorindicatesyoucould
startyourpresentation.Atfirstyoutrytoshowclassan
interestingvideoinslidesandadjustthesoundtoan
appropriatevolumetoattracttheirattention.
121
#3
Youaretheinstructorofaclassandsupposedtogivea
lecture.Youhavesomeprintedmaterialsonyouhand
whichyouwanttopresenttotheclass.Usingthe
podiumtopresentthoseprintedmaterials.
149
#4
Whenpresentingthoseprintedmaterial,itoccurstoyou
thatthereissomethingsimilarintheslides.Youwantto
changeonescreentothetheslidesonyoucomputer,
andkeeptheotherscreenpresenttheprintedmaterial.
203
#5
Afteryoufinishthecontentoftheprintedmaterial,you
arenolongerneedtousetheDocCam,soyoutryto
closetheDocCamandpresentslidesonbothscreen.
036
#6
Yourclassisover.Beforeleavingtheclassroom,you
needtoturnoffeverything(includethescreenand
projector).
105
Table1.OverallTaskPerformance(refertothetestplanforacompletedescription)
Page17of39
Post-questionnaire Data
AsshowingintheFigure10,Mostparticipantsperceivebothsetuppresentation,
closesystemandsynchronizethesourceasthesamelevelofdifficulty.Itisbecause
participantsmighthavealreadybeenfamiliarizedwithsystembytheprevioustasks.At
aresultmostparticipantsfeelsynchronizingthesourceiseasierthanseparatethe
source,eventhosetwotasksarealmostusethesamestepsandfunctionalities.
Figure10.Theaveragedifficultylevelforeachofthe6tasks
Inthefollowingpictures(Figure11.andFigure12.),participantsexpressedtheir
subjectivefeelingaboutusingpodium.MostparticipantschooseAftertryseveraltimes,
itcouldbefiguredoutandbelievethattheycouldfamiliarizewiththesystemafterthey
dopresentationinthisinterfacethreetimes.
Page18of39
Figure11.Thedistributionofthecontrolpanelinterfacecomprehensiblelevel
Page19of39
Figure12.Thedistributionoftheexpectedtimeneededtofamiliarwiththecontrolpanel
interface
Figure13.TaskCompletionTimeforEachParticipant
Page20of39
Figure14.AverageCompletionTimeforEachTask
If Participant spend too much time on one task, monitor will give a little hint to help
participantscompletetheirtask.Andparticipantsalsohaveoptionstoaskfor help.Here
Figure15.showstheaveragenumberofHintsgivenforeachtask.
Figure15.AverageNumberofHintsgivenforEachTask
Page21of39
Figure16.TaskMistakeNumberforEachParticipant
Figure17.AverageNumberofMistakeforeachTask
In summary, because the learning effect, task 5 (Synchronize The Source) andtask 6
(Close System) basically need less time and hints to be achieve.CompareFigure14,
15and 17,we found thattask 1 (Set up Presentation)needrelativeahighernumberof
Page22of39
In thethinkaloudtranscript,wewillpointoutspecificproblemswhichparticipantsmetin
eachtasks,andrelatethoseproblemwithpossiblesolutions.
Fromourtestdata,wediscoveredthefollowingwidelyprevalentproblems:
Problems
p1 p2 p3 p4 p5 p6 p7 p8 p9 p10 Feq
Pullingdownthescreenisnotmemorable
Noindicationonpodiumshowingthestateofconnection 1
Didnotknowtheyneedtochooseasourceforprojector. 0
Pressthescreendownbuttonwithoutrelease
Thestopbuttononthe"screencontrol"panelisnot
workingappropriately
Confusedabouthowtousethescreenpaneltocontrol
thetwoscreens
Nofeedbackforlatency
Difficulttofindtheadvanceaudiobutton
AdjusttheMicgroupintheAudioControltochangethe
volume
Confusionaboutthefunctionofvolumecontrolbuttonon
thehomepage
1
Task1 The"PC"optionisconfusing
Difficulttomapthetermmainandprogramtotheir
Task2 functions.
Page23of39
UsercouldnotfindthephysicallocationoftheDocCam
Itisawkwardforuserstowatchthescreenback
andforthtoadjustthepositionofmaterialand
zoomin/out.
Thetermof"screencontrol"istoovaguetounderstand
Thetermof"CameraControl"iseasyto
misunderstanding
Thetermof"input"inDocumentCameraisconfusing
The"screencontrol"buttonistoovaguetounderstand
10
The"input"buttonleadawrongunderstandinginthis
section
Don'tknowhowtocontrolthetwoprojectorseparately,
justrandomwalkaroundthecontrolpanel
Theterm"individualmode"and"presentationmode"is
misleading
Difficulttorememberthe"display1"and"display2"
Task4 belongtowhichscreen
Lackofvisibilityofsystemstate(individualmodeand
Task5 presentationmode)
Task3
Focus,Iris,Freezewereunabletobemappedtotheir
functionsbytheusers.
PresstheScreenscrollupbuttonwithoutrelease
Pullingupthescreenandclosetheprojectorisnot
Task6 memorable
Table2.summaryofthinkloud
Problem
Detail
Pullingdownthescreenisnotmemorable
Practically,Sincewhiteboardalsosupportsto
displayforprojector,mostparticipantsdonot
realizethattheyneedtopulldownthescreen
Task Noindicationonpodiumshowingthestateof
1
connection
Therearethreeparticipantstotallyforgotthey
didnotconnecttheircomputertothepodium,
andtherewasnomessageshowingonthe
podiumpadindicatedthattheywerenot
connectingtoanysource.
Page24of39
Didnotknowtheyneedtochooseasourcefor
projector.
Thereareoneparticipantdidnotrealizethathe
orsheneedtoselectansourceforprojector.
Pressthescreendownbuttonwithoutrelease
Thestopbuttononthe"screencontrol"panelisnot Someparticipantsfoundtheycouldnotstopthe
workingappropriately
screen,whileitisscrolling.
Confusedabouthowtousethescreenpanelto
controlthetwoscreens
Alotofparticipantsexpressedtheirconfusion
aboutwhytherewasonly"screen1"control
panelinthescreencontrolbox,howshould
theycontrol"screen2"?Andeventheyfound
therewasasmallinstruction("Presstwice")
theywerestillnotsureifthisinstructionwasfor
pullingdownscreen2.Theyalsoconfused
aboutwhereandhowtopresstwice.
Nofeedbackforlatency
Therewasoneparticipantsetupthepodium
appropriately,howeverduetothelatency,she
wasnotsureifshediditrightandbegantotry
someotherbuttons
The"PC"optionisconfusing
ThereisansouceoptionPC,whichisfor
connectingthecomputerfixedonthepodium,
notfortheprofessors'orstudents'ownlaptop.
However,someparticipantsthoughttheywere
connectingtotheirPC,sotheychosethis
optioninsteadofVGAorHDMI.
Difficulttofindtheadvanceaudiobutton
Therewasoneparticipantexpressedthatthe
audiocontrolbuttonwasnotclosetothe
volumebuttononthescreen,whichmakeitwas
hardtoawarethatthereisanadvanceaudio
control.
AdjusttheMicgroupintheAudioControltochange
thevolume
Confusionaboutthefunctionofvolumecontrol
buttononthehomepage
Halfparticipantsexpressedtheyexpectedthat
thevolumebuttononthehomepagecould
adjustaudiofromvideo.Aftertheyfounditis
notforadjustingvolumeofvideofromthe
browser,theyconfusedaboutwhatdoesthe
"main"volumecontrolonthehomepagedo.
Difficulttomapthetermmainandprogramto
Task
theirfunctions.
2
Halfparticipantstriedeverybuttonintheaudio
controlpanel,sincetheywerenotsure,what
doesthe"main"and"program"mean
Usercouldnotfindthephysicallocationofthe
Task DocCam
3
Whenparticipantspressedthe"Document
Camera,"theysawthescreenchangedthe
sourceto"DocCam."Howevertheycouldnot
figureout,whereisthelocationofthis"Doc
Page25of39
camera"byitsicon.Theybelievedhaving
informationaboutthelocationofcamerawould
increasetheirtrustinesstothesystem,andthey
couldoperateitmoreconfidently
Someparticipantsexpressedtheexpectation
Itisawkwardforuserstowatchthescreenbackand abouthavingthecontentfrom"Document
forthtoadjustthepositionofmaterialandzoom
Camera"onthescreen,sotheydonotneedto
in/out.
watchbackandforthtoadjustthepositionand
size.
Thetermof"screencontrol"istoovagueto
understand
OneParticipantthoughtthe"screencontrol"will
containtheoptionforgetDocumentCamera
Thetermof"CameraControl"iseasyto
misunderstanding
Halfparticipantthoughtthe"CameraControl"
buttonwouldhelptomanipulatetheDocument
Camera.
Thetermof"input"inDocumentCamerais
confusing
Someparticipantsexpressedconfusionabout
whatdoesthe"input"buttondo.
Focus,Iris,Freezewereunabletobemappedto
theirfunctionsbytheusers.
The"screencontrol"buttonistoovagueto
understand
Alltheparticipantswerepronetochoose
screencontrolbutton,whentheywantedto
separatetheinputsourcesfordifferentdisplays.
The"input"buttonleadawrongunderstandingin
thissection
Someparticipantsthoughttheinputbuttonin
documentcameraisfordifferentinputsources.
Don'tknowhowtocontrolthetwoprojector
separately,justrandomwalkaroundthecontrol
panel
Theroommodewastoovagueforparticipants
tomaptoitsfunctionality.Mostparticipants
havenoideaaboutwhichbuttonshouldbe
pressed,whiletheyweretrytoseparatethe
sourcefordifferentdisplay.
Mostparticipantsabstainedfromselectingthe
Theterm"individualmode"and"presentationmode" individualmode,sincetheotheroption
ismisleading
presentationmode,feltmorerelevanttowhat
theyweredoing..
Someparticipantshopedthereisabetterway
toindicatethescreenisbelongto"display1"or
Difficulttorememberthe"display1"and"display2" "display2".Therearenosignifiers/markersto
belongtowhichscreen
indicatethemappingbetweenDisplay1and
Task
Display2textsonthepodiumtotheprojector
4
screens.
Task Lackofvisibilityofsystemstate(individualmode
5
andpresentationmode)
Sometimes,participantstendedtoforgetthat
theywereintheindividualmodeandperformed
taskstoachievetheendresultsinthesame
mode
Page26of39
PresstheScreenscrollupbuttonwithoutrelease
Task Pullingupthescreenandclosetheprojectorisnot
6
memorable
Sometimes,theyforgottoscrollthescreenup
beforeshuttingdownthesystem.This,upon
questioning,wasbecausetheyassumedthe
systemtohandlealltheseoperationswhenthey
optedtopoweritdown.
Table3.DetailofProblems
Page27of39
Recommendations
Based on each problems, we give related suggestions (See Appendix Problem VS
Solution).Herewesummarythosesuggestionswithdifferentareaoftheinterface.
Figure18.HomeScreen
Upper Area
ChangePCtoPodiumPCintheupperareaofHomeScreen(Figure18)
TheIconofDocCamcouldbechangedtoamorerelevantpicture.
Page28of39
Figure19.DocCamPage
Delete the empty button in the Doc camera page (Figure 19), such as Input
FocusIris.
Insteadofonlyusingdisplay1anddisplay2intheupperareaofHome Screen
(Figure), adding the icon like >or <mighthelp themto map the buttonto
specificdisplay.
Right Area
Change the name ofCameraControlin the rightbottomareaofHomeScreen
(Figure 18) to "Recording Camera" since a lot of participant think this button
couldcontroltheDocCamera
MovetheAudioControlbuttonclosetotheVolumepart.
The Volume control at the home page could present the voice from program,
since mostly people use the volume control panel to control the voice from
differentapplications.Ifmute isonin anyof the othervolume controls,thestate
shouldbereflectedinthehomepageVolumecontrol
Figure20.AudioControlPanel
Showing in the Figure 20, the Main could change to System sound and the
ProgramcouldchangetoApplicationsound.
Page29of39
Bottom Area
The room mode is hard for participants to map the termto its functionality. We
suggest to changethelogic.Forexample,keepdisplay1anddisplay2 onthe
interface all thetime, and change theroom modeto Syn display.Then users
couldcontrolbothscreenandsynchronizetwoscreenwhenevertheywant.
Left Area:
The "Screen Control" should change the name to "Scroll Screen" orsomething
relatedto avoid misunderstanding,andthisfunctiononlyusedwhenuserwantto
scroll up or downtheprojector screen duringthepresentation. Screen Control
iseasilymisleadparticipantinseveralways.
Figure21.ScreenControlDialog
Add"Screen2"intheScreenControldialog(Figure21),eachdialogcontrolsone
screenandmapstothecorrespondingphysicallocation.
Scrolling the screen down automatically after the control panel is powered on,
andscrollitupafterpowereddown.
Page30of39
Notification
Ifonerequest is in processing,awarningto noticethe user thatthesystemisin
processing.Thewarningcouldbedisappeared,whenprocessingisfinished.
Page31of39
Appendix
Sheclickthestartbuttonandselectthepresentationmode.Beforeconnectingthecableto
thelaptop,shefirstselecttheHDMIasthesource,thenchangetoPC,andchangebackto
HDMIagain.Shethenrealizedthatsheneedstopluginthecabletothelaptopfirst.Thenshe
choosetheHDMIcableandconnectedwiththelaptop.Afterthat,sheclickthescreen
control,androllthescreendown.Sheclickthedownbuttonwithoutrelease.Afteronescreen
wentdown.Shedon'tknowwhytheotherscreendoesn'tchange.Shehesitatedfora
moment,andnoticedthattherewasaPressTwicemessagethere,soshetriedtoclickthe
downbuttonagain,andthesecondscreenstartedtoscrolldown.Sheclosethescreen
controldialogandcheckthevideosourceagain.Andthetaskdone.
Task2
ClicktheVolumebuttonatthehomepage,butthesounddoesn'tgetanychange.Thenshe
wenttotheAudioControl,shejustclicktheMutebuttonattheMaingroup,andthesound
wentdownimmediately.Soshefindthebuttonthatcouldcontrolthesound.
Task3
AtfirstshethoughttheScreenControlmenuisforopentheDocCam,butsheforgotthisis
onlyforcontrollingthescreenscrollupanddown.Thenshequitthemenu,andstarttofocus
onthevideosource.ShefirstselectthePCasthevideosource,thensoonshefoundthe
iconwithaCameraismoreclosetoherjob,sosheselecttheDocCambutton,andthe
camera'simagestarttoshowonthescreen.Shetriedtomakestheimageofthephysical
materialonthescreenmoreclearly.ShejusttrieddifferentbuttonsontheDocumentCamera
menu,butafterclick"Iris"and"Focus"thereseemsnochange.Actually,atthismomentshe
alreadydonethetask,butshedidn'trealizedthat.AndclicktheCameraControlmenuto
clickthebuttonsonthat,butnochangewiththeDocCam,sincethisoptionisforcontrolling
anothercamerabutnotheDocCam.FinallyshewentbacktotheDocCamoptionsanduse
theZoominandoutagaintomakestheimageonthescreenmoreclear.
Task4
ClicktheScreenControl,butquicklyfindthiswaswrong.ThenshewantstoclicktheCamera
Control,butbeforeclick,shethoughtthisshouldnotbethatrightcontrolsogiveup
immediately,andwenttotheRoomModebutton.Afterclick,shefindindividualmodeisa
newbuttonnevergettired.Afterclicktheindividualmode,theDisplay1andDisplay2
buttonsontopofthecontrolpanelclearlyindicatethatshecouldselectdifferentsourcesfor
differentscreen.ThensheselecttheHDMIforDisplay1andDocCamforDisplay2.
Task5
ClicktheRoomModebutton,andchangethemodebacktopresentationmode,andreselect
theHDMIastheinputsource,thistaskgetdoneveryquickly.
Task6
ClicktheScreenControl,andclickthescreenupbuttonwithoutrelease.Afterallthescreens
scrolledback,sheclicktheSystemOffbuttonandturnedoffthecontrolpanel.
Participant2
Task1
HeconnectedthelaptoptothepodiumthroughHDMI.Then,heselectedHDMIasinput
sourceandopenedthepresentationinthelaptop.Then,hewaspromptedtobringthescreens
down.HeclickedonscreencontrolandpressDownarrowbuttontobringthefirstscreen
Page32of39
down.Then,heneededhelpwithpullingthesecondscreenout.Wegavehimahintandhe
wasabletofinishthetask
Task2
Hestartedbyopeningtheaudiosourceinthelaptopandplayingit.Then,clickedonthe
volumeup/downbuttononmainscreentoadjustthevolumelevelindicatortillitreachedthe
middle.
Task3
Heclickedtheroommodetoswitchtoindividualmode.Whenthecontrolsdidnotlookrelevant
tohisperceivedstate,heswitchedbacktopresentationmodeandclickedoncameracontrol.
Herealizedthecontrolswerenotrelatedtohismentalimage,soheclickedonscreencontrol.
Thenherealizedscreencontrolwasusedforcontrollingthescreenmovement.Then,he
clickedonDocCamand,whentheoutputwassameasexpected,heclickedonzoomin/outto
adjustthecamerasettings.Then,heclickedonInputs1,2,3toseetheirfunctions.Hemadea
finaladjustmenttotheDocCamzoomandfinishedthetask
Task4
First,heclickedonroommodeandselectedpresentationmodebecausehethoughtindividual
modewasforjustpresentingtohimself.Then,inthepresentationmode,heselectedHDMI,
DocCam,Screencontrol,Cameracontrolinrandomorderrepeatedlyexpectinganoutput.In
DocCam,hecontinuouslyclickedthedifferentinputsmultipletimesassumingthefeedback
tooktimetohappen.Then,whenheaskedforhelp,wehintedattryingadifferentmodeand
thenhewasabletofinishthetask
Task5
HefirstselectedDocCamandclickedDisplayoff.Then,heselectedHDMI.Hethenswitched
topresentationmode,selectedHDMIandclickedDisplayOn.Hewaitedforanoutput.When
therewasnofeedbackforalongtime,heagainclickedonroommodetoselectpresentation
modetofinishthetask.
Task6
Hestartedbypoweringdownthesystem.Then,herealizedthescreensarenotrolledbackto
theirslots.So,hepoweredonthesystemandselectedpresentationmode.Then,heclicked
onscreencontrolandbroughtthescreensupintotheirholders.
Participant3
Task1
HeconnectedtheHDMItothelaptop.Then,heworkedonadjustingthecomputersettingslike
resolution.Thenheopenedtheslidesonthelaptopandpoweredonthepodiuminterface.
Oncethepodiumsystemwasreadytouse,hetriedthePCfirstthentriedHDMItoachievethe
desiredoutput.Thentheparticipantwaspromptedtobringthescreensdown.Uponprompt,he
clickedScreencontrolbuttonandfounditeasiertobringthescreen1down.However,hewas
confusedandtrieddifferentbuttonsonscreencontrolpanelforsometimeonhowtobringthe
secondscreendown.Then,hewasgivenahinttotrythedownbuttonagainandithelpedhim
infinishingthetask
Task2
Hestartedwithclosingthescreencontrol,whichwasopenfromtask1.Then,heincreasedthe
volumebypressingtheupbuttononvolumecontrolpanelonthemainscreen.Then,he
playedthevideofromthelaptop,andtriedadjustingthevolumeusingtheup/downbuttonson
volumecontrolpanelonmainscreen.Heclickedmutebuttonanditworked.But,hewas
confusedwhytheup/downbuttonswerenotworking.Then,heclickedtheAudiocontrolbutton
onthebottomrightofthemainscreen.Headjustedthevolumeusingup/downbuttonsunder
theProgrampanelontheAudiocontrolscreen.ThenhetriedthesamewithMainpaneland
founditdidnothaveanyeffect.However,hefoundoutthatmutebuttononallthepanels
controlledtheaudiooutput.
Task3
Hestartedbyunderstandingthathehastochangethedisplayinput,soheclickedonDoc
Cambecausethatlookedrelevanttothetaskofpresentingprintedmaterial.Then,hefound
thatitwillhelphimachievethegoal.Hethenmovedtheprintedmaterialwithintheregionof
captureofthecameraandadjustedzoomusingthebuttonsontheDocCamscreen.Then,he
triedFocus,Irisbuttonstojustseetheeffectsontheoutput.Then,hetriedFreezebutton
Page33of39
assumingitwillfreezethecamerainstanceatthelastcapturedscenesothatifhemovedthe
handoverthematerialit'llnotaffectthecapturedsceneonthescreen.
Task4
HestartedbyclickingInputs1/2/3onDocCamscreen,becauseitwasthescreenopenfrom
task3.Then,whenherealizeditwon'thelphimwiththistask,hetriedtheCameraControl.
Whenthatdidn'tlooklikearelevantscreen,hetriedscreencontrolandrealizeditwasfor
controllingthescreens.Then,hetriedAudiocontrolandCameracontroltounderstandwhat
theydid.Then,heclickedtheRoommodeandtriedtheIndividualmode.Whenthescreens
hadtwodisplaytabs,hewasconvincedthatheisattherightscreenandselectedtherequired
twoinputsources.
Task5
Hestartedwiththeindividualmodebecausethatwasthescreenfromtask5.Hechangedthe
inputsourcesofDisplay1and2toHDMItoachievethegoal.Also,heclickedonRoommode
andchosePresentationmode,thereby,resultinginthesamegoal.
Task6
HestartedbyopeningScreencontrolandpressedtheUparrowbuttononcetobringthefirst
screenup.ThenwaitedtillitwascompletelyupandclickedtheUparrowbuttonagaintobring
thesecondscreenup.HeclickedDisplayoffbuttononthemainscreenandsawthatone
displayturnedoff.Soheclickedondisplay2andtriedDisplayoffbutnothinghappened.He
changedtoPresentationmode,clickedDisplayoff,andboththedisplaysturnedoff.Thenhe
powereddownthesystem
Participant4
Task1
ShestartedwithconnectingcomputerwithHDMI.Thensheopenedtheslidesonthedesktop.
Aftershesettedupthecomputer,shefoundprojectorwasnotworking.Shebegantotrythe
podium.Shepressedtheopenbuttonandchosethepresentationmode,sinceshethoughtshe
wasgivingapresentationrightnow.FirstshepressedtheHDMI,sinceshebelievedthe
computerwasconnectingthepodiumwithHDMI.Howevertherewassystemlatency,so
projetordidnotlightupimmediately.Shethoughtmaybeshepressedawrongbutton,soshe
begantotrythescreencontrolbutton.Itisbecause,shethoughtitisscreenwhichwasnot
lighteduprightnow.Whenshepressthe"up"button,theprojectorjustlightedup,soshe
wronglytookthe"up"buttoninthescreencontrolmenuastheprojectorcontrolbutton.She
forgettoscrolldownthescreen.Afterweremindedherthatsheneedtopulldownthescreen,
shewenttothescreencontrolpanelagain.shewasnotsurehowtopulldowntoscreen2
sincethereisonly"screen1"controlpanelinthescreencontrol.Shewasalsonotsurewhere
to"Presstwice"
Task2
Shepressedthevolumebuttononthepad.Howeveritwasnotworking.Shefeltfrustrated
whentheaudiowasnotworkingassheexpected.shetrytopressthebuttonforalongtimeto
makesureitisreallynotworking.Shedidnotfindtheaudiocontrolpanelatthefirsttime,
sinceitwasnotclosetothevolumecontrolonthemainscreen.
Task3
Shequicklyfoundthedoccambutton.Shetriedtofigureoutifthiswouldwork.Shewas
confusedaboutwhatdidbuttonsinthedocumentcameracontrolpanelmean,soshetried
differentbuttonstoseewhatwouldchange.sheisconfusedwhatdidthe"freeze"means.She
confusedaboutwhatdoes"input"do.
Task4
Shetookthe"input123"buttononthedocumentcameracontrolpanelasdifferentsources
forscreen,butitwasnotworking.Shewasnotsurewhereshecouldchangetodifferent
sources.Shetriedthecameracontrolandscreencontrol.Shehastriedtheroommode,
howevershedidnotchangetoindividualmode,sincepresentationmodeseenmorerelatedto
currentsituation.Aftershetriedindividualmode,shequicklyfoundthereweretwodisplay
selection,soshecouldchooseasourcefordifferentdisplays.
Task5
ShewentbacktopresentationmodeandselectHDMIassourcefordisplay.Shesaidaftershe
figuredouthowtochangemode,itbecameeasyforhertocontrolthescreen
Page34of39
Task6
Sinceshealreadyknowhowtopulldownthescreenup,shepressedthe"up"buttontwiceto
scrolluptwoscreen.Howevershewasstillnotsurewhensheshouldbegantopressthe
secondtimes.Thesheeasilyfoundthesystemoffbuttonandclosedall.
Participant5
Task1
Shewasconfusedabouthowtowherecouldchangeto"screen2"topulldownthesecond
screen.participantswentintothescreencontrolpanel,wentout,andtriedtofindanother
buttontopullthescreen.Thenshefoundthe"presstwice"instruction,butshestillnotsure,
functionality,howandwhereneedtopresstwice.Shetriedtopress"screen1"andthetopof
the"screencontrol"eventhereisnobutton.Aftershefigureoutthepodium,sheforgetto
connectthecomputertothepodium.
Task2
Shefoundthevolumeinthemainscreenwasnotforthecomputer.Shewasconfusedwhere
sheneedtopresstocontrolthevolumethenshegiveup.Shecouldnotfigureoutifthesound
isgoodenough.Afterwepushedhertomakethesoundloudershetriedtheaudiobutton.
Thenshetrieddifferentbuttonssinceshewasnotsurewhichoneiscontrolthevolumefrom
herPC
Task3
Task4
AtfirstshetriedtopresstheHDMI,bothscreenchangedtoHDMI.Shetriedtheroommode,
howevershefeelshewasinthepresentationmode,soshedidnottrytheindividualmode.
Shetriedthedocumentcameraandfeltthe"input123"inthedoccamerapanelwasnotfor
thedisplay.Shetriedthescreencontrol,andthepanelremindherthatitwasforpullingthe
screen.Afterwetoldherthatthiswasthetwomode,shequicklyfoundthetopchangedand
manipulatedthemseparately.
Task5
shedirectlywenttothepresentationmode,thenselectedtheHDMIasinputsource
Task6
sheknownthatthe"screen1"controlledbothscreen,soshekeptpressingtheupbuttonuntil
bothscreenscrollup.Thensheturnofftheprojectorbydisplaypanel.Andpressthepoweroff
buttontocloseall
Participant6
Task1
Shewasnotsurewheresheneedtocontrol,sinceinthepastsheonlyconnectedthe
computertothepodium,thentheprojectorwouldlightupitself.Aftergivenhint,participant
selectedtheVGAasinputsource.Howeversheforgettopullthescreendown.
Task2
Weremindedherthatsheforgottoplugintheaudiolineatveryfirst.Thenshequicklyfound
theaudiocontrolpanelandtrieddifferentcontroltoadjusttheaudio
Task3
Shequicklyfoundthedoccamera'spositionandstartedtoadjustthecamera'sposition.She
hopedshecouldseewhatwasinthescreen,becauseitisalittlebitinconvenienttoturnback
tocheckifthepositionofdocumentisOK
Task4
shewasnotsurewhereshecouldcontroldifferentscreens.Shethoughtthecameracontrol
mighthelptochangethesourceofoneprojector.Aftershefounditwasnotworking,shetried
severalbuttonstofigureouthowtodothatcameracontrol,doccamera,screencontrol.She
triedtheroommode,shethinkshewasinthepresentationmode,soshedidnotchangeto
individualmode.Afterallshetriedtheindividualmode,shecouldeasilyfigureouttherestof
stepbytheinterface.
Task5
Sheforgetshewasonlycontrollingoneofthescreenandnotsurewhichscreenbelongto
"display1".ShefoundtheVGAdidnotworkwellinindividualmode,soshechangedthemode
topresentationmodetosynchronizebothscreen
Page35of39
Task6
sheusedthe"systemoff"buttonandforgettopullupthescreenandclosedtheprojector.
Participant7
Task1
HewasnotsurewhetherheshouldselecttheHDMIorPC.AfterhefoundthePCwasnotfor
thelaptop,hequicklychangedback.HeForgettopullscreendown.Duringhepulleddownthe
screen,hewasconfusedwhereisthecontrolforthesecondscreen.
Task2
Hebegantoadjustthevolumeonthescreenwithoutplayingthevideo.Theadjustmentof
volumewasverysmall,sohewasnotsurewhichcontrolthevideovolume.Hefinallyfigured
outtheprogramcontrolsthevideo,howeverhesaidheexpectthevolumecontrolinmain
controldothis.
Task3
Hequicklyfoundthedoccamera.Howeverhedidnotfindwherethecamerais,sohecould
notputthematerialintherightplaceatthefirsttime
Task4
Hetriedthescreencontroltoseeifthiscouldhelphimtoseparatethescreen.Hetried
individualmodeundertheroommode,andfounditwasworking.Howeverheisnotsurewhich
onecontrolwhichscreen.
Task5
Hetriedtwowaytoaccomplishthetask,bychoosesamesourcefortwodisplayorselectthe
presentationmodetosynchronizethesource
Task6
Hehopedwhenheturnedthesystemoffthescreenshouldbepulledupautomatically
Participant8
Task1
Hestartedthepresentationinthelaptop,thenconnectedtothepodiumusingHDMI.He
poweredonthepodiuminterfaceandselectedHDMIasinputsource.Hewaspromptedabout
thescreensafterthat.Heclickedscreencontroltobringthescreensdown,andheremarked
thatthetext"Presstwice"helpedhimwithcontrollingthesecondscreen
Task2
Headjustedtheaudiooutputofthelaptopinitially.Then,headjustedthevolumecontrolonthe
mainscreenofthepodiuminterface.When,thecontrolsdidnotadjusttheoutputvolume,he
clickedonAudiocontrol,triedthecontrolsunderMain.Then,hetriedthecontrolsunder
Program,andadjustedthevolume.
Task3
HestartedbyclickingCameracontrolbecausehethoughtitwillcontrolthecamerafor
presentingdocuments.Then,heclickedDocCamandadjustedthezoomforbetterresolution.
HealsoclickedonIrisandFocustounderstandtheirfunctions
Task4
HeclickedonScreencontrolandthenrealizeditwasforcontrollingscreenmovements.Then,
heclickedonroommodeandselectedpresentationmodebecausehefeltindividualmode
wouldbeusedforpresentationstoselfwithnoaudienceintheroom.Thenhetriedthe
differentinputsourcesandthecontrolsineachoneofthem.Then,wehintedhimtotrya
differentmode.Heselectedindividualmodeandcompletedthetask
Task5
HeselectedtheDisplay1andclickedHDMI,thenselectedHDMIunderDisplay2.Also,he
showedanotherwaytocompletethetaskbyswitchingovertoPresentationmodeand
selectingHDMIasinputsource.
Task6
HeturnedthedisplayoffbyclickingtheDisplayOffbuttononthemainscreen.Then,he
powereddownthesystem,assumingthatwillhandleturningoffothercomponentsofthe
system.Then,hewaspromptedtocheckthescreens.And,heturnedonthesystemtobring
thescreensupandthenturnedoffthesystem.
Participant9
Page36of39
Task1
Atfirstshethoughtthethingsdisplayedonthecontrolpanelshouldalsodisplayedonthe
screen.Aftergivenareminder,thatthevideosourceisfromthelaptop.Shebegantoopenthe
slidesandmakesthepowerpointinpresentingmodel.Anotherhintwasgiventostart
controllingtheprojectorsbythecontrolpanel.Shepresstheturnonbuttonandthenthe
presentationmodebutton.Sheforgottoconnectthelaptoptothepodium,soanotherhintwas
given,andsheconnecttheHDMIcabletothelaptop.Thecontrolpanelasktheusertoselect
asource,shefirstpressthePCbutton,andwaitforawhile,butnothingdisplayedatthe
screen.Shethoughtitmayneedsometimetowaituntilthethingsgetdisplayed.Thenanother
hintwasgiventhatsheneedstoselectHDMIasthesource.Thenshepressscreecontrol,and
pressthedownbuttontoletthescreendown.Shealsonoticedthe"presstwice"hints,and
pressthedownbuttonagain,andallthetwoscreenswerescrolldown.
Task2
Aftershestartedtoplaythevideo,shecontinuouslyclickthevolumebuttonontherightsideof
thehomepage.Butdoesn'tchangeanything.Thenshestartedtoclickthe"AudioControl",
andopenandialog.Shedidn'trealizedthatshewasclickthebuttononthe"Mic"ground,this
actuallycontrolthevolumeofthemicrophonecurrentlydon'tuse.Afterahintwasgiven,she
noticedthesoundwasmutedintheMaingroup.ThensheclicktheMutebuttontoreleasethe
mutestatusattheMaingroup,andthesoundcomesout.Shedidn'tknowwhichgroupcould
actuallycontrolthevolumeofthesound,andshestartedclicktheupbuttonattheMaingroup,
butthesounddidn'tchange.Thenshetriedthelastoption,theProgramgroup,andthevolume
getcontrolled.
Task3
AtfirstshethoughttheCameraControlwastherightoptiontoopentheDocCam.Afterturned
intothemenu,thereseemsnocontrolfortheDocCam,shewantedtoexitthemenu.And
incorrectlyclicktheRoomMode.However,shewentbacktothehomepage.Shestillwantto
takealookatCameraControltoseeissomebuttonshewasmissedthatcouldcontrolthe
DocCam.SoshewentintotheCameracontrolagain.Butstillfailedtofindtherightbutton.
Thenahintwasgiventotoldherlookatthebuttonwithiconsthatisclosesttothetask.Then
sheclickedtheDocCamiconandthecontentofthematerialstarttodisplayatthescreen.
Task4
Wethetaskgetstarted,shedidn'thaveanyideawhattodo,soshewasjustrandomclick
manybuttonssuchasScreenControl,CameraControlandalsoswitchbetweendifferent
source.Thenwegaveahinttoldhertochangetheroommode.Aftersheenteredthe
individualmode,sherealizedatthetopofthecontrolpanelexisttwobuttonswhichareDisplay
1andDisplay2.AndsheselecttheHDMIsourceforDisplay1andtheDocCamsourcefor
Display2.
Task5
ShechangetheroommodebacktoPresentationmode,andassignedtheHDMIasthe
source,thenthetaskgotdone.
Task6
Wenbacktoscreencontrolandrolloneprojectorscreenbackwithoneclick,andafterthefirst
done,clicktheupagaintorolltheotherscreenback.Thendisplayoffandsystemoff.
Participant10
Task1
HepickedtheHDMIcableandconnectedtothelaptop.HeknowsthatHDMIcansupport
audiooutput,sohedon'tusetheaudioline.Pressthestartbuttonandselectthepresentation
modeandwaittillthesystemstartsup.Duringthewaitingtime,hemakesthepowerpointin
thepresentationmode.Afterthetwoprojectorsbegantowork,hebegantothinkingwhich
sourceshouldselect,andhenoticedtheHDMIbutton,andpressit.Theimageonthelaptop
thenstarttodisplayonbothscreens.Hethoughthefinishthetaskatthismoment.Buthe
forgettoscrollthescreendown.Ahintwasgivenregardingthat,buthefeltitdoesn'tmatterif
thescreenisdownornot.Aftersomeexplanation,hepressthescreencontrol,andthedialog
shows"screen1"andhewassuretopressthedownbuttontoletscreen1wentdown.Since
hedidn'tfindthedialogfor"Screen2",hequitthescreenselectionmodetofindisthere
anotheroptiontocontrolthescreen2.Afterfailedtofind,hewentbacktothescreencontrol,
Page37of39
andnoticedthe"presstwice"hintonthedialog.Hefirstdon'tknowwheretopresstwice,then
herealizedthattopressthedownbuttonagain.Andbothscreengotdownatthismoment.
Task2
ClicktheVolumebuttonatthehomepage,butnothingchanged.Thenhewenttothe"Audio
Control",andhefoundtheprogramvolumewassetat0,sohequicklyclicktheupbuttonat
theprogramvolumegroupandmakesthesoundcameout.
Task3
ClickCameracontrolatfirstbuttherewasnocontrolovertheDocCam.Thenhestartedtolook
aroundtofindisthereisaCameraexisttosupportthetask.Afterfailedtofindthecamera,he
wentbacktotheInterfaceofthecontrolpanel,andtheiconthatlookslikeacameraandclick
it,theDocCamstarttowork.
Task4
Firstclickthescreencontrolbutfindthisisnotforthistask.Thenhejustlookattheinterfaceto
seewhichbuttonistherighttocompletethetask.Aftergazedforawhile,heclickthescreen
controlagain,butstilldidn'tfindtherightway.Thenhekeepthink,andtriedroommode,and
thinkindividualmodeissomethingdifferentwhichhasnevertried.Afterselecttheindividual
mode,hefindtheDisplay1andDisplay2buttonsappearatthetopofthecontrolpanel.And
heassigneddifferentsourcestothetwodisplays.
Task5
Hesaidtherearetwowaystofinishthetask,oneiskeeptheindividualmode,butassign
HDMIasthesourceforboththetwodisplays.Anotherwayischangetheroommodebackto
Presentationmode,andselectHDMIasthesource.
Task6
Clicktheredbutton"SystemOff".Hefoundtheprojectorsshutdown,butthescreenstillkeep
there.Heopenthesystemagain,clickthescreencontrol,androlldownthetwoscreensback
byclicktheupbuttontwice.Hethoughtthereisnoneedtoadjustthevolumeback,soheturn
offthesystemagainby"SystemOff"button.
Problem VS Solution
Problem
Solution
Pullingdownthescreenisnotmemorable
Scrollingthescreendownautomaticallyafterthe
controlpanelispoweredon,andscrollitafter
powereddown.
The"ScreenControl"shouldchangethenameto
"ScrollScreen"orsomethingrelatedtoavoid
misunderstanding,andthisfunctiononlyused
whenuserwanttoscrollupordowntheprojector
screenduringthepresentation.Sincebydefault,
userwillonlywanttheimagefromtheprojectorgo
tothescreen.
Noindicationonpodiumshowingthestateof
connection
Task Didnotknowtheyneedtochooseasourcefor
1
projector.
Ifthevideosourcethatismappedwiththeinput
sourceisnotdetected,awarningshouldbegiven
tonotifytheusertoconnecttherightvideocable
tothelaptop.Ifnoactivesourceisconnectedwith
thepodium,thecontrolpanelshouldnotifythe
userorindicatethestatusclearly.
Page38of39
Pressthescreendownbuttonwithoutrelease
Thestopbuttononthe"screencontrol"panelis
notworkingappropriately
Add"Screen2"intheScreenControldialog,each
dialogcontrolsonescreenandmapstothe
correspondingphysicallocation.
Confusedabouthowtousethescreenpanelto
controlthetwoscreens
Nofeedbackforlatency
Ifonerequestisinprocessing,awarningtonotice
theuserthatthesystemisinprocessing.The
warningcouldbedisappeared,whenprocessingis
finished.
The"PC"optionisconfusing
ChangePCtoPodiumPC
Difficulttofindtheadvanceaudiobutton
MovetheAudioControlbuttonnexttothe
VolumeControlpanel
AdjusttheMicgroupintheAudioControlto
changethevolume
Confusionaboutthefunctionofvolumecontrol
buttononthehomepage
TheVolumecontrolatthehomepagecould
presenttheprogramsincemostlypeopleusethe
volumecontrolpaneltocontrolthevoicefrom
differentapplications.
Ifmuteisoninanyoftheothervolumecontrols,
thestateshouldbereflectedinthehomepage
Volumecontrol
Difficulttomapthetermmainandprogramto
theirfunctions.
TheMaincouldchangetoSystemsoundand
theProgramcouldchangetoApplication
sound.
Sincemostpeopleinthepretestquestionnaire
expresstheirpreferenceofcontrollingeverything
fromcomputer,OnandOffbuttonscouldbe
enoughforpresenters.
Usercouldnotfindthephysicallocationofthe
DocCam
Itisawkwardforuserstowatchthescreenback
andforthtoadjustthepositionofmaterialand
zoomin/out.
Thetermof"screencontrol"istoovagueto
understand
Task
2
Task Thetermof"CameraControl"iseasyto
3
misunderstanding
Changethenameto"RecordingCamera"
Page39of39
Thetermof"input"inDocumentCamerais
confusing
DeletetheemptybuttonintheDoccamerapage,
suchasInputFocusIris.
Focus,Iris,Freezewereunabletobemappedto
theirfunctionsbytheusers.
The"screencontrol"buttonistoovagueto
understand
The"input"buttonleadawrongunderstandingin
thissection
Don'tknowhowtocontrolthetwoprojector
separately,justrandomwalkaroundthecontrol
panel
Theroommodeishardforparticipantstomapthe
termtoitsfunctionality.Wesuggesttochangethe
logic.Forexample,keepdisplay1anddisplay
2ontheinterfaceallthetime,andchangethe
roommodetoSyndisplay.Thenuserscould
controlbothscreenandsynchronizetwoscreen
whenevertheywant.
Theterm"individualmode"and"presentation
mode"ismisleading
Difficulttorememberthe"display1"and"display
Task
2"belongtowhichscreen
4
Insteadofonlyusingdisplay1anddisplay2,
addingtheiconlike>or<mighthelpthem
tomapthebuttontospecificdisplay.
Task Lackofvisibilityofsystemstate(individualmode
5
andpresentationmode)
PresstheScreenscrollupbuttonwithoutrelease
Task Pullingupthescreenandclosetheprojectorisnot
6
memorable