Dr Tin Myo Han Medical Statistics Unit, Kulliyyah of Dentistry IIUM

Data collection and Validity of Research Data collection tools for Quantitative study Development of Questionnaires

Data

Management Data Management Process for Quantitative study Take home Message Assignment for students
Data collection & Management 1/4/2012

INTERNAL VALIDITY

Data collection & Management

1/4/2012

Questionnaires, Format
Validity of Questionnaires

Instruments and Materials

Standardization of Data collecting instruments

Data collection & Management

1/4/2012

Questionnaires -self-administered, - face to face Interview , - filling form/format

-Clear Instruction , -Guideline for Interview - make a consensus

( to reduce inter-reviewers variation (bias)

Instruments & Materials Procedures to measure ( BP, Hb%, tooth size)

Standard Operating Procedures (SOP) ( clinical trials & Basic science)

Data collection & Management

1/4/2012

Error : writing , typing error, coping error

Data entry Data cleaning Data analysis ( includes in the proposal)

Appropriate statistical tests ( based on types of data )

Data collection & Management

1/4/2012

Data collection & Management

1/4/2012

1. the process of preparing and collecting data that is both defined and accurate. 2. the process of gathering and measuring information on variables of interest, in an established systematic fashion that enables one to answer stated research questions, test hypotheses, and evaluate outcomes.
3. capturing, recording, validating and editing data

for completeness and accuracy

Data collection & Management 1/4/2012

Questionnaires

data collection format for assessment of oral health status

data collection format for interventional study

Data collection & Management

1/4/2012

Based on objectives of the study

Data collection & Management

1/4/2012

10

a theoretical framework Conceptual framework Identify the predisposing factors ( causal factors) and outcome (effect) measures Plan for the data analysis
Choose/create

theoretical framework Conceptual frame work assists to describe, explain and predict a behavior or outcome It also assists to identify relationship between variables It reduces the chance of excluding important variables

Theoretical structure of assumptions, principles, and rules that holds together the ideas comprising a broad concept

Assessment on effectiveness of Oral Hygiene Education session provided by 4th year dental students at Students Poly Clinic, Kulliyyah of Dentistry 2011-2012".

Data collection & Management

1/4/2012

14

How to measure ( Indicators) Factors Effectiveness OHE session By 4th year Dental students v

Outcomes

Knowledge, Attitude & Oral Hygiene Practices

Others?

Exposure

Socio-demo economic status Peer , family support

Accessibility & availability of OH materials ( HE Materials , Tooth paste, Tooth brush

Objective 1. To identify socio-demographic and economic background of respondents 2. To compare oral Hygiene Knowledge of Patients before and after OHE session 3. To compare attitude of the patients on proper OH practices before and after OHE session 4.To compare oral hygiene practices of the patients before and after OHE session 5. To compare OH status (plaque score??? ) of patients before after OHE session 6. To find out gender and economic influences on OHP changes of patients 7. To assess influences of accessibility and availability of OH materials on OHP changes of patients

Objectives 1.Sociodemographic and economic 2. Knowledge on OHP 3. Attitude on OHP 4.OH Practices

Questionnaires & Format Q 1-5

Variables Age, sex, education, occupation, income ect. ???? ???? ????

Operational Definition ?????

Measurement scale ?????

Q 6-20 Q 21- 26 Q/ format 27-37 Format 38-45

???? ????? ?????

???? ???? ????

5. OH status

-Plaque score -???

???

????

6&7 ( Inferential Statistic)

Based on data from Objective -1&4

Anticipate the data analysis Think about how you would like to summarize the data ( dummy tables) How you analyze the data determines the kind of data you collect ( Categorical, Nominal, Numerical data) Think about response burden. Avoid just-in-case syndrome (more is not necessary better)

Variable Age Group (yr) 20 30 31-40 41 -50 51-60 >60 Min, Max, Sex Male Female Education Illiterate Basic education Middle High Graduate

No

Mean SD

Data collection & Management

1/4/2012

19

Variable Knowledge ( 15Qs) poor ( 0- 5) Fair ( 6-10) High ( >10) Min, Max Mean SD (score) Attitude ( 5 Likert scale) Strongly agree agree Neutral Disagree Strongly disagree Practices ( 10 Qs) Good acceptable likely acceptable unacceptable Min, Max Mean SD ( score)

No

Data collection & Management

1/4/2012

20

Status Before OHP session After OHP Significant test

Knowledge level High Fair Poor

Total

X2

Status Before OHP session After OHP Significant test

Knowledge level min max mean SD

Total

pair t

P =

Data collection & Management

1/4/2012

21

OHP changes ( score) of the patients ( Before)

Monthly total Income of Patients ( RM)

Fig :Correlation between OHP ( score) of the patients and their monthly total income r= p=

Data collection & Management

1/4/2012

22

A good questionnaire: Assist to collect data to answer the research question includes all important independent (predisposing factors) and dependent variables (outcomes) gathers valid information (what it meant to ask) gathers reliable information (repeatable) is easy to answer by respondents (user-friendly)

Contents of a questionnaire Predisposing factors (independent variables): patient/practitioner/practice socio-demograghic profile/background patients clinical profile exposure ( HE session, tooth extraction, BMI )

Outcome measures (dependent variables) E.g. satisfaction, behavior, morbidity, mortality changes of Hb%, BP , Knowledge , attitude, practices

Structure MCQ, Open question, SBA, Fill in blank, Format for Clinical/ experimental findings Format and language: font size and style readability text flow instruction clearity; (eg, Please choice one
or more/ Please circle one or more )

Beware of: double-barrel questions leading questions sensitive questions language inconsistency

Validating a questionnaire

Data collection & Management

1/4/2012

29

Always get some one to proofread the questionnaire Supervisor

 Face validity

Content validity Criterion validity Theoretical validity

 The

extent of questionnaire validation depends on: the purpose of the study the resources and time frame previous validation

 Does the

respondent give the same answer with repeated testing with the same questionnaire/interviewer? (intra-rater reliability) Does the respondent give the same answer if the questionnaire is administered by different interviewers? (inter-rater reliability) Does the respondent give the same answer whether it is self-completed or interviewer administered?

 Is

the question ambiguous? Should the questionnaire be self-completed or interviewer-assisted?

Be clear about the research question Determine the dependent and independent variables Capture data with the analysis in mind think how you are going to summarize the data Arrange the questions in a logical manner Use simple language and avoid confusing questions/statements Pilot test the questionnaire to ensure validity and reliability

Use an established questionnaires if there is one

Data collection & Management

1/4/2012

38

Data: the raw material of statistics

Quantitative

data

Qualitative data

Management :is the activity of getting

things done with the aid of people and other resources.

Data Management:

Managing data (data Mining) into Meaningful information.

Data collection & Management 1/4/2012

39

Data handling & recording

Data coding & Cleaning

Data entering

Data calculation

Data Checking

Data cleaning
Practices SPSS Hands on trainingin Computer session

Data collection & Management

1/4/2012

40

First, think about your data in terms of what kind of data it is! (continuous, discrete and ordinal) Second , specify the type of a variables Recording in Questionnaires and observational form

Data collection & Management

1/4/2012

41

 Create

new

variables using compute and recode

Data collection & Management

1/4/2012

42

Every study should be accompanied by a code book that describes each variable by name according to the type of data ,the units of measurement , the purpose of collecting it and its relationship to other data.

This code book should be kept in a separate file from the data itself and should be available to all researchers on the study.
Data collection & Management 1/4/2012

43

Variable Identification No of student Age ( completed age) Sex

Variable name code age

Variable Value ( Code) 1----- 36 20- 25

Measurement Discrete numerical year

Sex

1= Male 2= Female e.g 1 = Single 2 = Marriage 1 =Malay 2 = Chinese 3 = India 4 = Others

1/4/2012

Nominal/ Categorical Nominal

Marital status

Marriage

Race

Race

Norminal

Data collection & Management

44

Types plain text files ; spreadsheets database programs statistics packages

Name of Soft-ware Excel

Access or MySQL SAS, SPSS, Stata or Minitab and Epi info

Each of these has advantages and disadvantages Before you decide on which ones to use

Data collection & Management 1/4/2012

45

 Sorting

in a spreadsheet Backups: Data files should be stored on drives that are backed up regularly Consistency: Consistency in data entry is crucial.( F/M or 1= Male, 2= female0 Units of measurement: Units for measurements should be clearly identified whenever possible.
Data collection & Management 1/4/2012

46

Missing value Unintended missing values: Do not use blanks to represent zero because they could easily be mistaken as missing values.
Data collection & Management 1/4/2012

47

Manual ( small data set) soft-ware Generate frequency tables General histogram for numerical ( continuous) data Generate descriptive statistics for data set including measure of central tendency and dispersion

Data collection & Management

1/4/2012

48

Common procedures:
    

Eyeballing raw data Frequency table Descriptive data Box and Whisker plot Histogram

To find out outliers and extreme values

Data collection & Management 1/4/2012

49

Data collection & Management

1/4/2012

50

Data collection & Management

1/4/2012

51

 You but

don't need to understand the underlying calculus

you do need to know descriptive and inferential statistic and how to interpret it.

Data collection & Management

1/4/2012

52

questionnaire is the key data collection

instrument in quantitative research

Having a theoretical framework and planning the data analysis in advance are essential for designing a good questionnaire

valid, reliable and user-friendly

questionnaire is the key to a successful data collection

Data collection and Management are important for internal validity of the research Proper data collection methods and tools should be selected for respective study designs . Regarding structuring of questionnaires, background academic, socio-economic status of sample population( respondents) and possible bias should be considered. Each and every questionnaire should be tested in pilotsurvey to verify its structures and validity.

Data collection & Management

1/4/2012

54

Draw a conceptual frame work for your research project

Set aim and specific objectives List data collection tools for your research project Structure a questionnaires or a format to collect data for your research project

Draw a dummy tables Set data analysis plan

Data collection & Management

1/4/2012

55

Data collection & Management

1/4/2012

56