Evaluating a Modular Design Approach to Collecting Survey Data Using Text Messages: Evidence from Nepal

Type Journal Article - PSC Research Reports
Title Evaluating a Modular Design Approach to Collecting Survey Data Using Text Messages: Evidence from Nepal
Author(s)
Issue 15-834
Publication (Day/Month/Year) 2015
URL http://www.psc.isr.umich.edu/pubs/pdf/rr15-834.pdf
Abstract
This research note presents analyses of data from a pilot study in Nepal designed to provide an
initial examination of the errors and costs associated with an innovative methodology for
survey data collection. We embedded a randomized experiment within a long-standing panel
survey, collecting data on a small number of items with varying sensitivity from a sample of 450
young Nepalese adults. Survey items ranged from simple demographics to indicators of
substance abuse and mental health problems. Sampled adults were randomly assigned to three
different arms: a standard one-time telephone interview, a “single sitting” back-and-forth
interview with a live interviewer using text messaging, and an interview using text messages
within a modular design framework. Respondents in the modular arm were asked to respond
(via text messaging with a live interviewer) to only one question on a given day, rather than
complete the entire survey. We find that the two text messaging modes increased the
probability of disclosing sensitive information relative to the telephone mode, and that
respondents in the modular design arm, while responding less frequently, found the survey to
be significantly easier. Further, those who responded in the modular arm were not unique in
terms of available covariates, suggesting that the reduced response rate resulted in limited
nonresponse bias. Given these promising initial findings, we conclude by suggesting directions
for future research and testing.

Related studies

»
»