Rural Water Supply 2011-2013
Mozambique, 2011 - 2013
Get MicrodataIdentification
MOZ_2011_MCC-RWS_v01_M
Rural Water Supply 2011-2013
| Name | Country code |
|---|---|
| Mozambique | MOZ |
Independent Impact Evaluation
This report provides the results from (1) an impact evaluation of the MCA's Rural Water Point Implementation Program ('RWPIP') in Nampula and (2) an evaluation of the SSSS in Cabo Delgado.
The objective of the impact evaluation of the MCA's RWPIP in Nampula is to examine the extent to which the program objectives have been realized. Rigorous impact evaluations should allow causal claims to be made about program interventions and observed changes in outcome indicators, typically by comparing the beneficiaries of the program to a non-beneficiary comparison group.
The objective of the SSSS study in Cabo Delgado was to qualitatively analyze the performance of the systems from a financial, technical, and managerial perspective. The research was driven by the hypothesis that in larger, more densely settled communities, the SSSS and private operator model better serves water users' needs, is more cost effective, and more sustainable over the long term, as compared to the a handpump with water committee management approach.
Sample survey data [ssd]
Communities
Version
Anonymized dataset for public distribution
Scope
Coverage
Rural communities across the provinces of Nampula and Cabo Delgado.
For the household survey, the study population were members of households within the sampled communities. For the Water Committee interviews, the study population were water committees. Users of the handpumps and the small scale solar systems were the study population for the water point observations.
Producers and sponsors
| Name | Affiliation |
|---|---|
| Jenna Davis | Stanford University |
| Ralph Hall | Virginia Polytechnic Institute |
| Name |
|---|
| Millennium Challenge Corporation |
Sampling
The sample frame was designed to draw confident causal inference about the impacts attributed to the installation of handpumps in Nampula. In order to monitor these impacts, the following activities were undertaken:
• A baseline study in Phase 1 and 2 treatment and comparison communities was completed in June-July, 2011, which was mainly targeted at collecting pre-intervention information.
• A follow-up study in Phase 1 and 2 treatment and comparison communities was completed in June-July, 2013, to capture the changes that had occurred in these communities over a two year period.
The following lists provide a summary of the activities that were undertaken during each of the fieldwork expeditions. In both the baseline and follow-up study, two weeks of enumerator training and a pilot study were undertaken prior to the commencement of the fieldwork. The pilot study enabled the Stanford-VT team to test the logic in the household survey and review the structure of the data collected for omitted or incorrect values. It also provided the enumerators with an opportunity to follow all the fieldwork protocols and practice administering each of the surveying instruments. Following the pilot study, final adjustments were made to the surveying instruments and fieldwork protocols, and enumerators were retrained as needed to address any data entry errors made during the pilot study. The training of enumerators continued throughout the fieldwork when the Stanford-VT team's 'on-the-ground statistician' regularly reviewed potential data entry errors with each enumerator. This regular (nightly) review of data improved the overall data quality and prevented the enumerators from making systematic errors throughout the fieldwork.
2011 baseline study:
• 1,579 households surveys were completed in 54 communities (27 treatment and 27 comparison);
• 54 water committee or leader interviews were completed; and
• Water sampling was undertaken in 11 communities (from 39 community water sources and 259 household containers).
2013 follow-up study:
• 1,826 households surveys were completed in 62 communities (32 treatment and 30 comparison);
• 31 water committee or leader interviews were completed;
• 17 water point observations were undertaken in 17 communities;
• Water sampling was undertaken in 11 communities (from 32 community water sources and 873 household containers); and
• Water source variability sampling was undertaken in four communities (which consisted of 412 water samples).
In the baseline and follow-up studies, an average of 29 household surveys were completed in each community. Around three quarters (73%) of the households interviewed during the baseline study were surveyed again in the follow-up study. If the head of a household was not available after two attempts to contact them or had left the community, a replacement household was randomly selected into the follow-up sample. In the follow-up study, 78% of the households in treatment communities in our sample used a handpump.
During the follow-up study, if respondent from the baseline study was not available to interview or had left the community, a replacement household was randomly selected.
Phase 1 treatment communities received a handpump before the baseline study, whereas Phase 2 treatment communities received a handpump between the baseline and follow-up study.
During the two years that passed between the baseline and follow-up studies, a number of events impacted the original classification of the Phase 1 and 2 treatment and comparison communities. For example, as a result of poor geophysical conditions, several treatment communities did not receive a handpump and were subsequently reclassified as comparison communities. Further, during Phase 3 of the RWPIP, a number of handpumps were installed in comparison communities that were then reclassified as treatment communities. In total, nine treatment communities were reclassified as comparison communities and one was removed from the sample (due to the installation of a World Vision handpump), seven treatment and one comparison community in Moma were added to the sample; and eight comparison communities were re-classified as treatment communities.
73% of the households surveyed in the baseline study were resurveyed in the follow-up study.
An unknown number of households were skipped in the baseline and follow-up studies because of absence or refusal or inability to participate in the study.
N/A
Survey instrument
Baseline and follow-up household questionnaires in Portuguese with short English translations with the following modules: household composition, water sources, health, participation, sanitation, income and expenditures. Water committee interviews about perceptions of the project and the handpumps. One-day water point observations in 17 communities with a MCC handpump.
Data collection
| Start | End | Cycle |
|---|---|---|
| 2011-06 | 2011-07 | Baseline |
| 2013-06 | 2013-07 | Follow-up |
| Name |
|---|
| WE Consult Mozambique |
Three teams of four enumerators, including the team leader, were supported in the field by the logistics manager from WeConsult and the on-the-ground statistician from LISA, Virginia Tech's Laboratory for Interdisciplinary Statistical Analysis. A runner contacted district, local, and community leaders to gain permission for surveying within the communities before the survey teams arrived. The on-the-ground statistician, a statistics PhD student from Virginia Tech, reviewed data with the individual enumerators and team leaders to ensure high quality data were collected.
Data processing
Data editing took place in the field and was conducted by the on-the-ground statistician, a PhD student from the Department of Statistics and LISA at Virginia Tech. Water Committee and water point observation data were reviewed at multiple times, both in the field and during the analyses stages.
Data appraisal
Sampling of housheholds was based on a random walk. No sampling errors were calculated.
Access policy
Millennium Challenge Corporation
Millennium Challenge Corporation
http://data.mcc.gov/evaluations/index.php/catalog/76
Cost: None
Data Access
The dataset has been anonymized and is available as a Public Use Dataset. It is accessible to all for statistical and research purposes only, under the following terms and conditions:
- The data and other materials will not be redistributed or sold to other individuals, institutions, or organizations without the written agreement of Stanford/Virginia Tech.
- The data will be used for statistical and scientific research purposes only. They will be used solely for reporting of aggregated information, and not for investigation of specific individuals or organizations.
- No attempt will be made to re-identify respondents, and no use will be made of the identity of any person or establishment discovered inadvertently. Any such discovery would immediately be reported to Stanford/Virginia Tech.
- No attempt will be made to produce links among datasets provided by Stanford/Virginia Tech, or among data from Stanford/Virginia Tech and other datasets that could identify individuals or organizations.
- Any books, articles, conference papers, theses, dissertations, reports, or other publications that employ data obtained from Stanford/Virginia Tech will cite the source of data in accordance with the Citation Requirement provided with each dataset.
- An electronic copy of all reports and publications based on the requested data will be sent to Stanford/Virginia Tech.
The original collector of the data, Stanford/Virginia Tech, and the relevant funding agencies bear no responsibility for use of the data or for interpretations or inferences based upon such uses.
Hall, R. P., Davis, D., Van Houweling, E., Vance, E., Carzolio, M., Seiss, M., Russel, M. (2014) Impact Evaluation of the Mozambique Rural Water Supply Activity Under a Cooperative Agreement between MCC and Stanford University. Washington, D.C.: MCC.
Contacts
| Name | Affiliation | |
|---|---|---|
| Monitoring & Evaluation Division | Millennium Challenge Corporation | impact-eval@mcc.gov |
Metadata production
DDI_MOZ_2011_MCC-RWS_v01_M
| Name | Role |
|---|---|
| Millennium Challenge Corporation | Review of Metadata |
| Stanford University/Virginia Polytechnic Institute | Production of Metadata |
2014-02-28
Metadata version
Version 1.0 (February 2014). This is the first version of the document.
Version 2.0 (May 2015). Edited version based on Version 01 (DDI-MCC-MOZ-StanfordVT-2014-v01) that was done by Millennium Challenge Corporation.
The rural population of Nampula and Cabo Delgado.