Programa Nasional Dezenvolvimentu Suku (PNDS) Research and Evaluation Program 2014, Quantitative and Qualitative Baseline Surveys
Timor-Leste, 2014
Get MicrodataIdentification
TLS_2014_PNDSIE-BL_v01_M
Programa Nasional Dezenvolvimentu Suku (PNDS) Research and Evaluation Program 2014
Quantitative and Qualitative Baseline Surveys
| Name | Country code |
|---|---|
| Timor-Leste | TLS |
Other Household Survey
The Programa Nasional Dezenvolvimentu Suku (PNDS) is Timor-Leste's nationwide community-driven development program that will provide annual grants of $50,000 - $75,000 to 442 villages from 2013 to 2022. Grants will be used to fund small-scale infrastructure projects identified, planned, constructed, managed, and maintained by local communities.
The PNDS Research and Evaluation Program (PNDS-REP) was designed by the World Bank in partnership with the Government of Timor-Leste and the Australian Department of Foreign Affairs and Trade. The Research and Evaluation Program uses field surveys, monitoring activities, and experiments to analyze factors constraining PNDS impacts and to develop impact-enhancing design modalities.
The PNDS-REP baseline data was collected prior to the implementation of PNDS in the sample villages and spans socio-economic conditions, local infrastructure, social services, and development projects; and the structure and function of local governance.
The PNDS-REP Baseline Survey incorporated both a Quantitative Baseline Survey (NBS) and a Qualitative Baseline Survey (LBS). The respective methodology and instruments were designed to complement each other. The NBS employed relatively short household and local leader surveys to collect data on economic, institutional, social and other factors across a relatively large sample. The LBS, on the other hand, employed semi-structured interviews and direct observation administered over a relatively long period within a relatively small sample to explore complex local governance and development processes.
The qualitative survey covered 16 suku (villages) and was administered between February and August 2014. The quantitative survey covered 102 suku and was administered between June and August 2014.
The follow-up surveys will cover the same villages as baseline surveys covered. The baseline surveys provide information that, when combined with data from follow-up surveys, may be used to construct before-and-after comparisons to indicatively assess the impacts of PNDS, the distribution of those impacts within and between villages, and analyze factors conditioning the level and distribution of impacts.
Sample survey data [ssd]
- individuals,
- households,
- villages
Version
v01
Quantitative baseline datasets
2015-02-18
Scope
Quantitative Survey:
- villages, hamlets and households general characteristics,
- assets,
- income and livelihoods,
- food consumption,
- agriculture,
- roads,
- irrigation,
- drinking water,
- sanitation,
- electricity,
- education,
- health,
- public works projects,
- local governance,
- conflict and social capital
Qualitative Survey:
- social cohesion,
- formal and informal local institutions,
- public goods and services
Coverage
National
Producers and sponsors
| Name | Affiliation |
|---|---|
| Andrew Beath | World Bank |
| Yuhki Tajima | Georgetown University |
| Erin Steffen | World Bank |
| Prerna Chowdhury | World Bank |
| Miks Muizarajs | World Bank |
| Name |
|---|
| Government of Timor-Leste |
| Australian Department of Foreign Affairs and Trade |
| Name |
|---|
| World Bank |
| Name | Role |
|---|---|
| Catalpa International | Programming of quantitative surveys, design of web interface, maintenance of the software |
Sampling
- The Quantitative Survey (NBS) was administered to a sample of 102 villages (suku) randomly selected from PNDS Phase-III villages, which in turn are a random sample of the 442 villages scheduled to be mobilized by PNDS but are the last of three batches of villages to be mobilized by PNDS. Within each of the 102 villages, two hamlets (aldeia) were randomly sampled and, in each of these two hamlets, eight households were randomly sampled.
In each sample village and hamlet, questionnaires with Village Chief (Xefe Suku) and Hamlet Chief (Xefe Aldeia) surveys were administered, respectively. Within each sample hamlet, 8 households were selected through random sampling. The sampling of households was conducted in the field with the village or hamlet head. The sampling procedures consisted of three steps:
- Access List of Households: In many cases, a list of households in the hamlet was available in the office of the Hamlet Chief or on a board outside the office. When a list of households was not readily available, the field team constructed a list of households in conjunction with the Hamlet Chief.
- Numbering Households: If the list of households in the hamlet was not already numbered, the field team assigned a number to each household sequentially.
- Random Sampling: The total number of households (N) was entered into a random number generator application installed on the electronic tablets used by the field team for data collection. The random generator produced a random sample of 12 integers between 1 and N (total number of households). The first eight households formed the primary sample households, while the next four households served as reserves.
- The Qualitative Survey (LBS) was administered to 16 villages sampled from among the 102 villages selected by the NBS. The 16 villages were sampled to provide balance across the following criteria: region, rural vs. peri-urban, intensity of conflict, veteran population and proximity to border.
Within sample villages, respondents were selected using three sampling methods:
- Purposive Sampling. A list of key stakeholders (e.g., Village Chief, Hamlet Chief, Ritual Leader, and the local Priest) was prepared prior to the arrival in each field site. Such stakeholders regularly participate in local governance activities and oversee local public works projects. Key respondents were interviewed in the earlier stages of data collection, with additional stakeholders identified and interviewed throughout the field visit.
- Snowball Sampling. Additional respondents were identified based on referrals from key stakeholders throughout field visits.
- Convenience Sampling. Research teams purposively selected easily accessible respondents and interviewed them at their houses or during community events. This sampling methodology was utilized in the final stages of the data collection cycle primarily to access marginalized villagers.
Each method was executed at a different stage of a 12-day data collection cycle.
Survey instrument
Quantitative Baseline Survey (NBS)
NBS consists of four different instruments:
Male Household Questionnaire (MHQ): The MHQ collects information on basic household characteristics; health; crops, irrigation, and income; consumption and markets; projects and community; decision-making and governance; cohesion; subjective well-being and satisfaction with public services; and information, social, and human capital. The questionnaire was designed to survey the male head of household or, in the absence of such, a working-age male between 30-59 years old. A total 947 MHQs were administered across the 100 sample villages.
Female Household Questionnaire (FHQ): The FHQ covers similar issues to the MHQ but also contains specific questions pertaining to maternal and child health. FHQs were administered to working age females between 30 and 59 years old and/or responsible for decisions regarding children in the household and/or day-to-day household activities. A total 1,114 FHQs were administered across the 100 sample villages.
Youth and Elderly Questionnaire (YHQ): The YHQ is a shorter version of the MHQ and contained questions on development projects and satisfaction with public services, local decision-making, and subjective well-being. The YHQ covers youth aged between 15-29 years and elderly aged above 55 years who reside in sample households and were not surveyed by the MHQ or FHQ. A total of 166 youth and 84 elderly respondents were surveyed across the 100 sample villages.
Village/Hamlet Chief Questionnaire (VC/HC-Q): The VC/HC-Q was administered to village and hamlet heads in the sample and ascertained information on village characteristics and the functions of chiefs. On average, one Village Chief and two Hamlet Chiefs were sampled in each village. However, one village contained only one hamlet and, in a number of villages, the village head was unavailable or refused to participate. In total, 198 Hamlet Chiefs and 95 Village Chiefs were interviewed.
Qualitative Baseline Survey (LBS)
LBS research instruments were developed to investigate the following narratives:
-
Social Cohesion: The research instrument was designed to investigate volume and quality of interactions between villagers and to further explore sub-themes such as: identity, conflict and conflict mediation, power and vulnerability, development needs and priorities, village and hamlet borders, historical context and reoccurring social problems.
-
Formal and Informal Local Institutions: The research instrument reviews defining processes occurring within villagelevel institutions, including local governance structures and community groups. The instrument further explored subthemes such as: leadership, power and decision making, financial management, collective action and communication strategies, and the creation and termination of village community groups.
-
Public Goods and Services: The research instrument mapped the life-cycle and quality of public goods and services within the village and explored sub-themes such as: project selection and decision making processes, project planning, project implementation, resource management, and development outcomes.
On average, research teams conducted 30 two-hour long semi-structured interviews per village.
Data collection
| Start | End | Cycle |
|---|---|---|
| 2014-02 | 2014-08 | Qualitative baseline survey |
| 2014-06 | 2014-08 | Quantitative baseline survey |
| Name | Affiliation |
|---|---|
| Dili Institute of Business | Quantitative data collection |
| World Bank | Qualitative data collection |
Quantitative Baseline Survey
Quantitative data was collected between June 20, 2014 and August 15, 2014 in 100 villages in all 13 districts of Timor-Leste. Data collection was undertaken using a computer-assisted personal interviewing system using Open Data Kit (ODK), an open-source set of tools used to author, field, and manage mobile data collection solutions.
Qualitative Baseline Survey
LBS field visit lasted 12 days per village and was conducted by teams of two local researchers. LBS utilized the following data collection methods:
-
Village Mapping: Upon arrival in the sampled village, a day-long mapping of village public works projects and institutions was completed. Using this information, an improvised map with coordinates of public facilities was designed.
-
Semi-Structured Interviews: Teams conducted an average of 30 audio-recorded interviews per field study site. Using LBS Research Instruments, a list of 23 themes was developed. In addition, a LBS Question Guide contained sample questions for each theme. Paper-based interview notes were compiled after each interview. Overall, 554 respondents were sampled, of which 65 percent were male.
-
Direct Observations: Research teams conducted direct observations of community meetings and events, public works construction processes, conflict mediation and other events within the village. For each observation, field notes were compiled, dated and assigned a theme.
Data processing
Quantitative Baseline Survey
Field staff members were issued Google Nexus tablets that contained electronic surveys. Completed surveys were sent from the field using 3G connectivity to a remote online server after each survey had been scrutinized by the team leader. A member of the PNDS-REP team in Dili checked incoming surveys and, if logical inconsistencies or any other faults in data quality were detected, contacted the relevant teams for further clarification or correction. The programming of surveys, design of web interface, and maintenance and upkeep of the software and server was outsourced to a private firm, Catalpa International.
Qualitative Baseline Survey
After each field visit, LBS research teams transcribed field notes, reviewed audio recordings, and developed a village report that incorporated qualitative data corresponding to the forementioned research themes. The village report incorporated the tools of process tracing and thick description. Process-tracing entails examining the step-by-step linkages that connect causes and effects of phenomena, with each step in the process is tested by examining various sources of data to ensure validity. Thick description was used as a data analysis tool, which involved reviewing field and interview notes and identifying recurring topics. Village reports were used as inputs to the analysis described in this report. Specifically, researchers utilized the cross-case data analysis method to formulate hypotheses and typologies.
Depositor information
| Name | Affiliation |
|---|---|
| Andrew Beath | World Bank |
Data Access
The use of the datasets must be acknowledged using a citation which would include:
- the identification of the Primary Investigator (including country name)
- the full title of the survey and its acronym (when available), and the year(s) of implementation
- the survey reference number
- the source and date of download (for datasets disseminated online)
Example:
Andrew Beath, Erin Steffen, Prerna Chowdhury, Miks Muizarajs, World Bank; Yuhki Tajima, Georgetown University. Timor-Leste Programa Nasional Dezenvolvimentu Suku (PNDS) Research and Evaluation Program 2014, Quantitative and Qualitative Baseline Surveys. Ref. TLS_2014_PNDSIE-BL_v01_M. Dataset downloaded from [URL] on [date].
Disclaimer and copyrights
The user of the data acknowledges that the original collector of the data, the authorized distributor of the data, and the relevant funding agency bear no responsibility for use of the data or for interpretations or inferences based upon such uses.
Contacts
| Name | Affiliation | |
|---|---|---|
| Andrew Beath | World Bank | abeath@worldbank.org |
Metadata production
DDI_TLS_2014_PNDSIE-BL_v01_M_WB
| Name | Affiliation | Role |
|---|---|---|
| Development Data Group | World Bank | Study documentation |
2015-07-06
Metadata version
v01 (July 2015)