ESCAP/WG/WHO ProjectonDisabilityStatistics

QualityAssurance Standards&Guidelines DOESNOTREQUIRETRANSLATION

June2009

These guidelines were originally produced by the WHO in collaboration with ESCAP for the WHO/ESCAP Project on Health and Disability Statistics 2004-2006. They have been revised in its current version for the ESCAP/WG/WHO 2007-2009 project.

Introduction
Ineverydatacollectioninitiativeresultsdependontheinput;astheprinciplegoes: garbage in garbage out. Whatever the quality of your instrumentation and analytical techniques, basic quality of the results depends heavily on the implementationofthesurvey,samplingandproperconductofthequestionnaire. Theseguidelinesidentifythefollowing: 1.QualityStandardsthatneedtobeadheredtoduringvariousstepsofasurvey. 2.QualityAssuranceproceduresthatidentifytheactionsinanexplicitmannerand monitorthesurveyimplementationinrealworldsettings 3. Evaluation of Quality Assurance process that measures the impact of Quality Assurancestandardsandprocedurestoimprovetheirefficiency. Overall aim of this Quality Assurance Guidelines is to provide support to improve qualityratherthantoauditthesurveyimplementation.QualityAssuranceisseenas anongoingprocessthroughoutthesurveyfrompreparationtodatacollection,data analysis and to report writing. The Quality Assurance Guidelines aim to ensure better understanding of the design of the Disability Question Set Testing and establishstandardssothat: thedatacollectionisrelevantandmeaningfulforthecountry'sneeds, thedatacanbecomparedwithinacountryandacrosscountriestoidentifythe similaritiesanddifferencesacrosspopulationsandlearnfromeachother, errors in data collection are minimized and data collection capacity in sites is improvedovertime.

QualityStandardsandAssuranceProcedures
QualityAssuranceisdefinedasanymethodorprocedureforcollecting,processing oranalyzingsurveydatathatisaimedatmaintainingorenhancingtheirreliabilityor validity.QualityStandardsandAssuranceproceduresrefertoallthestepsincluding: 1. Translation 2. Training 3. Surveyimplementation 4. Dataentry/Datacapturing 5. Dataanalysis 6. Interaction,teamworkandsupport This document systematically reviews each step and introduces the Quality AssuranceStandardsineacharea. QualityAssuranceguidelinesalsoservetoorganizesurveyworkandanticipateand plan for implementation. This document therefore gives an overall guide to countriesonthetechnicalspecificationsofthesurveyaswellascriticalaspectsthat needparticularattentiontoensurecollectionofgoodqualitydata. Theseguidelineswillalsoserveasanevaluationtemplateforthestudycoordinators andotherstaffformakingastructuredanddetailedassessmentoftheprocess.This
Quality Assurance Guidelines 2

willsupportsitesinassessingqualityinasystematicmanner,andtoidentifyareasin surveyactivitythatcouldbeimproved.

1.Translation
To make meaningful comparison of data across cultures, one needs a relevant instrument that measures the same construct in different countries. Translation is therefore a key feature to ensure the equivalent versions of questions in different languages.Guidelinesforthetranslationofstudyinstrumentshavearisenoutofthe extensive experience of international agencies developing and implementing internationalstudieswithmultiplepartnersandlinguisticexperts.Theseguidelines emphasizetheimportanceofmaintainingtheequivalenceofconceptsandensuring procedures that identify possible pitfalls and avoid distortions of the meaning. Theseguidelinesaimtoensurethefollowingqualitystandards: Translation should aim to produce a locally understandable questionnaire. The original intent of the questions should be translated with the best possibleequivalenttermorphraseinthelocallanguage.1 ThedisabilityextendedquestionsetaimstouseEnglishlanguageonlyas aworkinglanguage.Idioms,localexpressionsorelementsthatmayprove problematicintranslatingtootherlanguagesareavoided.Questionby question specifications aim to convey the original meaning of the questionsandansweroptions. The questionnaire should preferably be first translated by health and surveyexpertswhohavebasicunderstandingofthekeyconceptsinthe areas.Thebacktranslationprocessislimitedtoonlyselectedkeyterms and those that proved to be problematic during the first direct translation. The back translation should be carried out by linguistic experts who would comment on all the possible understandings of the termsandsuggestalternatives.Aneditorialgroupunderthesupervision of the study coordinator should review the translation and back translationandreportbacktoESCAPaboutthequalityofthetranslation. Eachpilotcountryshouldsubmitareportonthequalityofthetranslation workattheendofthepilotphase. QualityAssuranceAdvisorsforthecountryshouldpayspecialattentionto theimplementationstepsinthetranslationprocessandcheckthelistof keytermswiththestudycoordinator.Thiswillbedoneduringthe5day visittothecountries. Evaluationoftranslation AfulltranslationofthequestionnaireshouldbesubmittedtoESCAPbeforethestart ofthepilotinterviews.Problemswiththetranslationprocessandissuesarisingfrom the translation of the questionnaire should be reviewed in consultation with the projectsconsultants.
1

IfyouarenotsureofthispleasecontactESCAPforclarification.
3

Quality Assurance Guidelines

 Discussions should be held with interviewers to understand the procedures employed in field when a term, phrase or question is not understood. These discussionsshouldreviewtheextenttowhichinterviewersarerequiredtoexplain andinterpretthequestionstorespondents.

2.Training
Trainingofinterviewersisthekeytodataquality.Thepurposeofsuchtrainingisto: ensureauniformapplicationofthestudyinstruments explaintherationaleofthestudyandstudyprotocol provideanunderstandingoftheintentofeachquestion/questionset motivateinterviewers providepracticalsuggestionsonhowtodealwithrespondents improvetheoverallqualityofthedata Selectionofinterviewers: Theuseofexperiencedinterviewersaswellaspeoplewhoarefamiliarwiththetopic of the survey is important. Interviewers should have at least completed the full period of schooling within their country and be fluent in the main language of the country.Individualcountriesmustdecidewhatfurtherlevelofeducationisrequired aswellaswhatformalassessmentswillbecarriedoutpriortoselection. The characteristics of the interviewers (age, sex, education, professional training, employment status, past survey experience, and so on) should be recorded on a separatedatabase.ThisinformationcanthenbelinkedtotheIDsofinterviewersfor each questionnaire completed and an analysis done of individual interviewer performance. Length,methodsandcontentoftraining: Trainingshouldbelongenoughfortheinterviewerstobecomefamiliarwithnotonly thetechniquesforsuccessfulinterviewing,butalsothecontentofthequestionnaire to be used. For experienced interviewers the training will be shorter than for less experiencedones.Theparticipationofhealthexpertsormembersofdisabledpeople organizationsisstronglyencouraged. Therecommendedlengthoftrainingis2to3days.Allthetrainingshouldbecarried outasfaraspossiblebythesameteamtoensureastandardtrainingeitherforall interviewersinonesessionorfordifferentgroupsatdifferenttimesandplaces. Aboostersessionisstronglyrecommendedifitcanbeaccommodatedatsomepoint duringthedatacollectionperiod.Suchaboostersessionshouldpreferablybeheld sometime towards the middle of the data collection period. This serves to review various aspects of data collection, focusing on those aspects that are proving complexanddifficultorwhicharenotbeingadheredtosufficientlybyinterviewers. Thissessioncouldalsoserveasafeedbackonhowmuchhasbeenachievedandthe positive aspects. The session should include feedback from the supervisors and central survey team to the interviewers, as well as from interviewers to the
Quality Assurance Guidelines 4

supervisorsandsurveyteam.Thiscanprovideveryusefulinformationonthetypeof problemsthefieldworkersexperiencedandhowpeoplerespondedtothequestions, allofwhichcanassistintheanalysisofthedata. Thetrainingmethodsshouldincludeasmuchroleplayingofinterviewsaspossible (with a minimum of one per interviewer). This method provides assimilation of interviewingtechniquesmoreeffectively.Oncetheinterviewhasbeenmasteredin roleplaying,apilottestinterviewshouldbepracticedwithrealrespondents.There shouldalsobeatleastoneopportunitytodoaninterviewwitharealliferespondent outside of the interviewer group before starting the actual data collection. The practice interviews should be tape and/or videorecorded as often as possible for review and feedback discussion within training sessions. Countries are encouraged tomakeastandardtrainingvideosimilartotheWashingtonGroupvideoofamock interviewifthisispossible.Feedbackshouldbegivenaftereachroleplayorpractice interview. Training materials should be provided to all interviewers to use as reference material. Any material provided should be comprehensively reviewed during the trainingandwhererelevantbetranslatedintothelanguagesusedinthecountry. Thecontentoftrainingshouldincludethefollowing: Administrativeissues Planningoffieldwork Reviewofallmaterialsprovided,includingquestionbyquestionspecifications Contactingprocedures,consentformsandconfidentiality Conductinganinterview Interviewproceduresinthefield Supervisioninfieldandreportingprocedures Structureofsurveyteamandroleofallmembersoftheteam Evaluationoftraining Evaluationoftrainingshouldoccuratanumberoflevels.Theinterviewersmustbe evaluatedinordertodeterminewhethertheyarecapableofinterviewingeffectively and what, if any particular support they require. The interviewers may in turn evaluatethetrainingprovidedandthetrainers.Thereshouldbeongoingevaluation duringtheinitialdatacollectionperiodandattheconclusionofthefieldwork. Theinterviewerscanbegivenaformalassessmentattheendoftrainingandsome formofcertificationprovidedtoeachsuccessfulinterviewer.Thismustbedecided and implemented by each country individually. Supervisors must be similarly evaluatedbythecentralsurveyteam. ContentandMethodsoftraining Contentoftraining The content of training should include all the relevant aspects as listed in the standardsaboveanddetailedbelow.
Quality Assurance Guidelines 5

 1. 2. 3. 4. 5. Contactingprocedures: consentandconfidentialityforms(ifapplicable) whentovisitthehousehold numberofcontactcalls howtodealwithrefusals howtodealwithdifficultrespondents howtodealwithdifficult/dangeroussituations providingassurancesofconfidentiality Reviewofallmaterialsprovided surveyinstrument(fullversionwithallrotationsifrelevant) surveymanual question by question specifications with clarifications for country specific contexts overview of survey protocol to understand role of data collection in overall process enumeratordebriefing Planningoffieldwork numberofinterviewstobeconductedperday timelineforcompletionofthesurvey informationrecheckedbysupervisors supervision storageofcompletedquestionnaires expectationsofinterviewersandsupervisors Administrativeissues expectednumberofworkinghours planningofinterviewsandsurveytimeline lengthofinterviews dresscodeandbehavior announcement of pilot test to the public (through flyers, brochures, newspaper,etc.)

Conductinganinterview keepinginformationconfidential conductingtheinterviewinprivacy askingquestionsexactlyasworded rulesforenteringresponses use of questionbyquestion specifications (these can be expanded by each countrytocapturelocalnuances) recordingquestiondifficulties 6. Interviewproceduresinthefieldwhattodowhen: interviewscannotbecompleted respondentinterruptstheinterview
6

Quality Assurance Guidelines

respondentbecomesathreatfortheinterviewer respondentrefusestoanswersensitivequestions interviewerfindsitdifficulttoasksomequestions respondentdoesnotunderstandaquestion howtoavoidrespondentfatigue

7. Supervisioninfieldandreportingprocedures supervisorystructure frequencyandnatureofsupervisionandfeedback editingofthequestionnairesforaccuracyandcompleteness trainingsupportbysupervisorstointerviewers grievanceanddisciplinaryproceduresbyoragainstinterviewer 8. Structureofsurveyteamandroleofallmembersoftheteam centralcoordinatingteamandprincipalinvestigator regionalstructuresandpeopleincharge teamsupervisors interviewers Trainingmaterials The materials provided must be relevant and user friendly. The aspects to review include: Translationofthematerials Presentationinauserfriendlyandaccessiblemanner Extentofuseofaudioand/orvisualmaterialswhenpossible

3.Surveyimplementation
Howasurveyisactuallycarriedoutinthefieldisthequalitydeterminingstepinthe overallprocess.Goodandstrongcentralorganizationofthesurveyateachsitewill help ensure quality. Each step (i.e. printing questionnaires, making sample lists, enrollingsubjects,sendingoutinterviewerteams,dailysupervisioninthefield,and soon)shouldbeplannedandreviewedcarefullyforquality. 1. Eachsiteshouldmakeacentralsurveyimplementationplanandataskcalendar in which the details of the survey logistic are laid out clearly. This plan should identify how many interviewers are needed to cover the identified sample. It should take into account nonresponse, incomplete interviews and the survey team'spresenceinalocation. 2. Each survey team should have a supervisor that oversees and coordinates the workoftheinterviewers,aswellasprovidingonsitetrainingandsupport.The ideal supervisorinterviewer ratio varies between 1:5 to 1:10 depending on the countryanddifferentlocations. 3. Supervisorsshouldsetoutthedailyworkatthebeginningoftheworkdaywith the interviewers and review the results at the end of the day. In this review
Quality Assurance Guidelines 7

interviewers will brief their supervisors about their interviews and results. Supervisors must examine the completed interviewers to make sure that the interviewersselectionoftherespondentsinthehouseholdisaccurate. 4. A daily logbook should be kept to monitor the progress of the survey work in everypilotcountry.Theelementstoberecordedare: the number of respondents approached, interviews completed and incompleteinterviews response,refusalandnoncontactrates 5. Thestudysitesmayconductapilotsurveyatthebeginningofthesurveyperiod, whichshouldlastoneortwodays.Thepilotshouldbeusedasarehearsalforthe main survey. The pilot period should be evaluated critically and discussed with the projects consultants who will stay after the 3day training to support countriesinconductingthispilottest.Afterthesedaysofconsultationswiththe projectsconsultants,themainstudyshouldstart. 6. Printing and practical collation of questionnaires (e.g. color coding the two differentquestionnaireversions)ishelpful.AllsitesshouldsendtoESCAPacopy oftheprinteddocuments. 7. Response rates should be monitored continuously and each center should employacombinationofvariousstrategiestoincreaseparticipationinthesurvey andreducenonresponse. 8. Call backs: survey teams should attempt up to three call backs. The average numberofthesecallbacksdependsontheresponserateandeachcentershould examine the gain in each additional callback and consult with projects consultantsregardingthesufficientnumberforthatparticularcountry. Treatmentofnonresponseandrefusals Forresultsfromadatacollectionexercisetoberegardedasvalid,responsesmustbe obtainedfromasufficientlylargeproportionofthesampletokeeppossiblesample lossbiastoanacceptablelevel,andthefinalsampleachievedmustbelargeenough to produce the test significance required. This is a particular problem for any data collection where response is dependent on the willing cooperation of randomly selectedhouseholdrespondents. There are a number of factors that can significantly reduce the size of the final respondentnonresponseandrefusalrates: 1. Useofanuptodatesampleframewillassistinreducingsamplelossdueto demolished,ornonexistentdwellings. 2. Havingclearlydefinedreasonsforthedatacollectionandidentifyingbenefits tobeobtainedwillfacilitaterespondentcooperation. 3. Makinginitialcontactwithselectedhouseholdspriortointerviewercontact: where possible. This should be done by mailing an explanatory letter/brochure to selected households prior to interviewer contact, or in
Quality Assurance Guidelines 8

areaswherethisisnotpractical,contactwithsomeonesuchasavillageelder or other 'significant person' who can be informed of the nature and importanceofthecollectionandcaninturnusethisinformationtoassistin gainingcooperationofselectedhouseholders. 4. Adequate interviewer training, including ability to explain the purpose and importanceoftheinterview,andsufficientpracticeinterviewingandtraining tobecomeproficientwiththewordingandsequencing. 5. Allowance within budget and time constraints for callbacks to households withnocontactatinitialvisit,andspreadofcallbacktimesathouseholdsto coverdifferenttimesofday/daysofweektomaximizepossibilityofcontact. 6. Having a plan for further nonresponse followup where possible within time/cost constraints, if sufficient response/sample take has not been achievedwithintheinitialinterviewertimeframe. It is central to identify the reasons for nonresponse; separation of refusals/part refusalsfromnoncontactsandfromsampleloss(e.g.vacant/demolisheddwellings) isimportant.Samplelosswillnotimpactondatainterpretation/accuracyotherthan by reducing the final effective sample size, and the initial sample should allow for sample loss to achieve the required sample size for the required precision. Non contactsandrefusalscanpotentiallybiastheresultstotheextentthatnoncontact and/or refusal respondents differ in their characteristics from the responding sample. For the initial test phase it will be very important for interviewers to record the reasons for a persons refusal, and in particular to identify if it was the subject matter and/or particular questions which resulted in the refusal. This information shouldberecordedindetailatthetimeofoccurrence,reportedbacktotheoffice, andalsodiscussedatinterviewerdebriefing. Interviewerdebriefing Welltrained field interviewers are in a unique position to evaluate the merits of survey training, design, survey question structure and wording. Debriefing interviewers in a group setting (similar to a focus group) is the most common methodused.Interviewerswhoconductthepilottestarebroughttogetherafterthe interviewing is completed and asked about their experiences administering the questionnaire.Typically,themoderatorwillreviewthequestionnaireitembyitemto identify any problems interviewers found with question wording, question sequencingandtheoverallflowoftheinterview. If not all interviewers can participate in the debriefing, then where possible those that do participate should consist of interviewers with varying years of experience and levels of interviewing skill. This is important because newer interviewers, or interviewers who have not acquired good interviewing skills, may have different concernsaboutaquestionnairethanexperiencedorwellskilledinterviewers. During interviewer focus groups it is critical that the moderator encourages participation of all attendees. He/she must ensure that a few participants do not
Quality Assurance Guidelines 9

dominate.Groupdebriefingsessionsshouldgenerallybeheldwithinafewdaysafter interviewingiscompleted. Anothertechniquetoobtaininformationfrominterviewersistheuseofinterviewer debriefing forms. After the pilot test is completed, interviewers complete a standardized rating form and rate each question in the pilot test questionnaire on selectedcharacteristics. Itwouldbebeneficialtoexamineataminimumthefollowingthreecharacteristics: Interviewerhastroublereadingthequestionaswritten; Respondentsdon'tunderstandwordsorideasinthequestion; Respondentshavetroubleprovidinganswerstothequestion;andtoobtain written feedback from the interviewers as to their perception of why problems/difficulties might have occurred. The frequency of occurrence should also be identified, as a rare problem would be less of an issue for correctionthanacommonone. Forthepurposesofthetesting,countriesshouldinstructtheirinterviewerstorecord their observations 'as they happen' to facilitate later summarizing and reporting in either a structured debriefing form, at a formal interviewer facetoface debriefing session,oriftimeandfundingallow,bothprocedures.

4.Dataentry
Thedataentryprocessisplannedsuchthatthereisimmediatelocaldataentryand centralcoordination.Itisessentialthatdatabetransferredtocomputermediaas soon as possible after collection. In this way standard routine checks can be easily done.Anyerrorsfoundcanthenbeaddressedwhilethesurveyisinprogressinthe field. The figure below describes the data flow in the survey and the quality assurance stepsthatrelatetothisdataflow.Aftertheinterviewisadministeredthefollowing stepstakeplace:

Quality Assurance Guidelines

10

Data analysts check: - representativeness - basic descriptive statistics - outliers

Analytical checks

Supervisor

Supervisors check: consistency quality completeness

Data entry

Data entry program check: range logical consistency

Program checks for: - inconsistencies - missing values - identification numbers - double data entry

Data checking

electronic data transfer through email or CD-Rom

Supervisorchecksthequestionnaireformbeforethedataentrystarts. DataentryisperformedbyusingthedataentryprogramprovidedbyESCAP.This programcontrolsrangesandlogicalconsistencies. DataissenttoESCAPinbatchesusingemailorCDRom. Once the data is at ESCAP we use other programs to check inconsistencies, missingvalues,problemswithidentificationnumbersortest/retestcases. Data analysts check for representativeness, basic descriptive statistics and outliers. ESCAPwillsendfeedbacktocountriesforwhichcorrectionsand/orexplanations willberequired.

Importantqualityissuesaboutthedataentry. 1. DataentryshouldbedoneusingtheESCAPdataentryprogramme.Useofother programsdoesnotprovidethesamefacilitiesandmaybedisadvantageous. 2. Thecompletedinterviewformsshouldbecheckedbythesupervisorbeforethe dataentrystarts. 3. Thedataentryprogramisonlyaccessibletotheresponsibleteammembersand nooneelse.Thisisessentialforconfidentialityofdata.

Quality Assurance Guidelines

11

4. ThesitesshouldbeverycarefulinenteringtheIDnumber.AlistofvalidIDsare sent to the sites. Using correct IDs is especially important for the retest cases sincetheIDisusedtomatchthetestcaseswiththeretestcases. 5. Certainrulesareappliedtomaintaintheintegrityandaccuracyofdatasuchas checkingwhetherthesamerespondentisusedtwiceandtheextentofmissing data. Evaluationofdataentry Thefollowingaspectsshouldbecarefullymonitoredandreviewed: Thenumberofdataentrypersonnelandtheirtraining Checkingproceduresandsupervisionofdataentry Timeperiodbetweencompletionoftheinterviewinfieldanddataentry NumberandregularityofcompletedinterviewssenttoWHOandproblems encounteredwithsendingofthedata.

5.Interaction,teamworkandsupport
Smooth and successful implementation of the survey requires teamwork and good collaboration within the team. The team refers to all involved including the coordinator,supervisors,Interviewersandanyothermembers.Thecoordinationof workdependsonclearunderstandingofcommonaimsandajointeffortinreaching thesegoals.Theteamasawholeisresponsibleforidentifyingsolutionstoproblems arisingduringtheimplementation.Towardsthisendtheremustbeclear,openand timelycommunicationofissuesandjointownershipofresponsibility. Each country has a coordinator who is responsible for overseeing the implementationofthesurvey.Themembersmakingupthecountryteamshouldget togetherinmeetingsandcommunicateonthestudyissues.Itisimportanttoshare thestudygoalsandthepotentialuseofthedataforpolicydevelopment. Evaluationofinteraction,teamworkandsupport Thediscussionshouldreviewthecountry'slevelofexpertiseforanalyzingthedata, producingthecountryreportonthedataandusingittoinformpolicydevelopment. Thenatureoftheexpertiseandthepossibleneedforadditionalsupportshouldbe noted.Ifthecountryhasahighlevelofexpertise,thediscussionshouldincludethe possibilitiesofthatcountryprovidingsupporttosurveyteamsinothercountries.

Quality Assurance Guidelines

12

APPENDIX GeneralChecklist 1. Samplingstrategy Samplingframeandnumberofstagesofsampling Stratificationwithinsamplingframe Samplingunitsateachstage Sizeofsamplingunitsateachstage Checkingonprocedureforselectionofrespondentinhousehold. 2. Training Numberofdaysoftraining Numberofinterviewerstrained Levelofexperienceofinterviewers Whodidthetrainingandtheirexpertiseintheareaofhealthsurveys Documentationused Practicalcomponentsroleplaying,observationinrealcontext Problemsexperiencedintraining 3. Timingofsurvey Completionofsamplingandselectionofhouseholds Fullsurveystartandendorexpectedend Startofdatacapturing Ethicalclearancewhenreceivedandfromwhom? 4. Translation Whatprotocolwasundertaken Whatissuescameupinthetranslation? Whowasinvolvedinthetranslationprocess? Allmaterialsthatneedtobetranslatedaretranslated Questionnaire Questionbyquestion specifications (only when the interviewers do not knowEnglish) Qualityassuranceguidelines Resultcodes 5.Fieldtest Wherecarriedout Trainingforpilot Qualityassuranceproceduresforpilot DataentryanyproblemsinusingESCAPprogram? Dataanalysisseeresultsandwhatproblemswereexperiencedintheanalysis Any changes in methodology arising from the pilot describe these and how theywereimplemented Anychangesintranslationarisingfromthepilotdescribetheseandhowthey wereaddressed
Quality Assurance Guidelines 13

6.Administrativearrangementsforfieldtest Numberofinterviewers,supervisorsandcentralcoordinators howissupervisiondone feedback Logisticsarrangements provisionofmapstoidentifyhouseholdstobesurveyed travel:howeasywasittotraveltothehousehold? whatsortoftransportwasused(car,boat,plane)andhowreliablewasit? teamorganization Contactprocedures howeasywasittocontacttherespondent howmanycontactcallsweremade? whatwastherefusalrateandwhatwasthemainreasonforrefusingtodo theinterview Paymentofinterviewers Consentformsigningandrecording(ifapplicable) Checkingproceduresinfieldbysupervisors Checkingprocedurescentrally Returnofquestionnairestocentralofficeandsecurity Final check on questionnaire and procedure for correcting errors (e.g. sending thembacktofield) 10% test/retest how are data entered test in main data file and retest in separatefileorallintoaseparatefile? Take notes and summarize before having a final discussion with coordinating team. Draftreportwithrecommendationsforanyactiontobetaken 7.Dataentry: Dataentrypersonnel Checkingproceduresandsupervision regularstatuschecks: toassessinterviewingprocess toreviewresponse,refusalandnoncontactrates to monitor results and ensure that data collection is implemented accordingtosurveyspecifications verificationrecords: Number of contact records (contact/contact attempt) is recorded in detail.Thisinformationwillbeusedtocheckthataninterviewhasbeen conducted. This information will be kept separate and secure from the surveydata. Completedinterviewsareconductedatleast10%ofeachenumerators interviewswillbeverifiedtoensurethatsomeanswersremainconstant (age,education,HC)andthattheinterviewhasbeendone. Checknumberofinterviewsalreadyconductedandplanningofinterview schedule Final result codes, for completed interviews, refusal or other, are assignedcorrectly Informedconsentformsaresigned.Iftheydonotneedtobe,checkthe reason.
Quality Assurance Guidelines 14

Allidentifyinginformationwillbedetachedfromquestionnairesanddata entryprogram.Itisthecentresresponsibilitytomonitorconfidentiality. Observedataentryprocess. What is the system used for keeping track of the number of questionnaires assignedtoeachinterviewer? Discussdataanalysisandneedforfurthersupport. 8.Questionnaires Chooseseveralcompletedquestionnairesfromeachinterviewerandcheckthe following: Coversheethasbeendetachedfromquestionnaire Handwritingislegibleandneat Optionshavebeenrecordedappropriately(e.g.optionsarecirclednot ticked,underlinedorcrossedout) Openendedquestionsareansweredwhentheyneedtobe Openendedquestionsarerecordedverbatim Questionsareskippedcorrectly UseofESCAPdataentryprogram Dataentryprogramisonlyaccessibletotheteamandnooneelsethereis asecuritycode.ThenameoftherespondentisnotlinkedtothisID. Thereisasystemforenteringdataregularly Countrycodeiscorrect Checkcodingindatabaseagainstthehardcopy Rangeerrors:responseisoutsidethevalidsetofanswers(e.g.age:348) Consistencyerrors:inconsistencyintheanswers(e.g.Rwith6yrsofageand married)considerwhatmayormaynotberealistic Routingerrors(e.g.aninterviewerfailstofollowskipinstructionsinQ. Tracederrorsshouldbecorrected.Itthisisnotpossible,theincorrectvalue mustbereplacedbyaspecialcodeindicatingthevalueunknown Missingdata Comparisonofdatasets Cleaningofdata SendingofdatatoESCAP 9.Dataqualitymeasures Responserates Missingdata Reliability:resultsoftest/retest

Quality Assurance Guidelines

15