Rapid data collection

using mobile phones

Johannes Hoogeveen

Data collection using surveys

Surveys allow to collect high quality data from households or firms

But surveys are: costly time consuming inflexible (once a questionnaire is designed it cannot be changed)

As a consequence: Surveys are typically not able to provide timely data or data that is needed to address urgent policy issues

Data collection using phones

Mobile phones allow to collect data from households and firms without a need to visit them

This allows mobile surveys to: collect data at low cost and rapidly collect data from the same respondent over time change questions every week or month

But the number of questions that can be asked is limited respondents may need training (and a phone!)

A word of caution
Mobile data can be collected in a variety of ways: Calls SMS Mobile surveys USSD Embedded on SIM card Avoid the attraction of technology. Simple call centers often do the job. They: work with all phones (also very low end ones) incur no cost to the respondent elicit responses from illiterate people are cheap. Cost of calling within network is low cost of labor in a call center is typically low Moreover call centers: allow enumerators to be well trained real time supervision and quality control are possible data collection is flexible: well trained enumerators can explain difficult questions and can ask follow up questions in repeat surveys, respondents appreciate personal contact
Low end phones do the

MOBILE DATA COLLECTION IN PRACTICE

A mobile phone call center

Dar es Salaam mobile phone survey 1: Baseline survey Phase

Scientific sample (550 households; 150 enumeration areas) Questionnaire collects basic data about respondents (personal details, location, education, basic welfare information) Use household visit to explain how mobile survey will work No phones were distributed (they were in Sudan!)

Phase II: Mobile data collection

respondents receive a notification by SMS 3 enumerators in call center call respondents over course of 2-3 days Weekly (8-20) questions Questions differ every week Respondents are remunerated with call credit

RESULTS AND LESSONS

Respondent answering

Results: service quality

Inconveniencies faced when visiting health facilities
Negligence by health Not clean Services is rude 5% 3% 5% 4% 15% 20% 48% 10% 20% 30% 40% 50% 60%

Corruption Long queue

No medicine There are no 0%

Results: opinions
Opinions about constitutional changes
70% 60% 50% 40% 30% 20% 12% 10% 0% President should President should Presidential power get more powers get less power to powers should to make decisions make decisions remain unchanged Don't know 5% 24% 59%

Results: track food crisis

Goods/services for which citizens report significant price changes

32% 39% Food Water Electricity Housing Beverages 4% Commuter bus transport

7% 5%

13%

Results: bed net use

Citizens reporting sleeping under bed net treated with Ngao

10% 20% Does not sleep under bednet Sleeps under long lasting insecticide treated bednet

Sleeps under bednet treated with Ngao 40%

30% Sleeps under an untreated bednet

Some lessons:
Most attrition happened in the first weeks. Main reasons:

Respondents did not fully understand, training is required Respondents did not have good phone access Maybe we should have prepared a small contract

Remuneration is appreciated, but the amount does not matter for the response rate In some areas, response rates are low because of problems with cell phone reception or electricity

Some training may be required

Most important:
Data is of good quality and nonresponse is largely random
Regression on participation in week 14 of survey
dF/dx 0.13 0.07 0.12 0.10 -0.02 0.00 0.05 0.05 T-stat 2.12 1.09 1.91 1.65 -0.55 0.99 0.99 1.05

D-wealthiest quintile 4th wealth quintile 3rd wealth quintile 2nd wealth quintile D-female Age in years D-Tshs 400 remuneration D-Tshs 500 remuneration

OTHER APPROACHES TO RAPID DATA GATHERING WITH MOBILE PHONES

100

150

200

50

0 Tip Top Mabibo Kwa Cassian Keko Mwanga A

Keko Molemo (behind Tanzania

Mabibo Relini Kigogo Landa Bar Mabibo kwa Kikanzo Ubungo Maziwa Aug-10 Pipe

Mkunduge
Mtogole Ali Maua A (Near CUF Elimika Manzese Midizini Manzese Kiembeni Tandale Uzuri Tandale kwa Tumbo Tandale Yemen Manzese Uzuri

Water price survey

Nov-10

Baseline survey collects price of water and telephone numbers of clients at 30 water kiosks. Follow up through telephone.

Prices at DSM water kiosks

Tandale Mafichoni
Tank Mivuleni A Mwembe Mkole Mivuleni B Manzese Kilimani Manzese Bakhresa Ali Maua B

Official price

Capitation grant monitoring

Telephone numbers from an existing data base were used to call 90 headmasters. They were asked to verify whether capitation grant had arrived by a certain date

Price data collection

Local enumerators in 21 rural and urban locations collect price data on a monthly basis. Enumerators use a paper booklet and fill a price form on a certain date of the month. The next day, they receive a call from a call centre to relay their data. Data is processed at the center and made public.

Business confidence

Telephone numbers of business were obtained from business incubator program 150 entrepreneurs are called every month. Questions about business confidence, investments and jobs created. Data is processed at the center and made public.

Roadblock monitoring

Selected truck drivers (20) on a three main routes beep a call centre every time they are stopped at a road block. Call centre operator calls back and asks specific questions:
Location

Time taken
Amount paid (identity of driver is known through his number)

This gives weekly data about number and location of road blocks

In conclusion

Data collected using call centers and mobile phones provides ample opportunity to collect
Relevant and Reliable data In a cost effective and flexible manner

But

contrary to what is often thought, rapid data collection using mobile phones requires less ICT skills and more typical survey skills as well as writing skills to implement effectively.

More information on experience with data collection using mobile phones in Southern Sudan can be found at: http://digitalmedia.worldbank.org/SSP/africa/mobile-phone-data-collection/