IHSN Survey Catalog
  • Home
  • Microdata Catalog
  • Citations
  • Login
    Login
    Home / Central Data Catalog / TLS_2014_PNDSIE-BL_V01_M
central

Programa Nasional Dezenvolvimentu Suku (PNDS) Research and Evaluation Program 2014, Quantitative and Qualitative Baseline Surveys

Timor-Leste, 2014
Get Microdata
Reference ID
TLS_2014_PNDSIE-BL_v01_M
Producer(s)
Andrew Beath, Yuhki Tajima, Erin Steffen, Prerna Chowdhury, Miks Muizarajs
Metadata
DDI/XML JSON
Created on
Dec 05, 2019
Last modified
Dec 05, 2019
Page views
83480
Downloads
6043
  • Study Description
  • Data Dictionary
  • Downloads
  • Get Microdata
  • Identification
  • Version
  • Scope
  • Coverage
  • Producers and sponsors
  • Sampling
  • Survey instrument
  • Data collection
  • Data processing
  • Depositor information
  • Data Access
  • Disclaimer and copyrights
  • Contacts
  • Metadata production
  • Identification

    Survey ID number

    TLS_2014_PNDSIE-BL_v01_M

    Title

    Programa Nasional Dezenvolvimentu Suku (PNDS) Research and Evaluation Program 2014

    Subtitle

    Quantitative and Qualitative Baseline Surveys

    Country
    Name Country code
    Timor-Leste TLS
    Study type

    Other Household Survey

    Abstract

    The Programa Nasional Dezenvolvimentu Suku (PNDS) is Timor-Leste's nationwide community-driven development program that will provide annual grants of $50,000 - $75,000 to 442 villages from 2013 to 2022. Grants will be used to fund small-scale infrastructure projects identified, planned, constructed, managed, and maintained by local communities.

    The PNDS Research and Evaluation Program (PNDS-REP) was designed by the World Bank in partnership with the Government of Timor-Leste and the Australian Department of Foreign Affairs and Trade. The Research and Evaluation Program uses field surveys, monitoring activities, and experiments to analyze factors constraining PNDS impacts and to develop impact-enhancing design modalities.

    The PNDS-REP baseline data was collected prior to the implementation of PNDS in the sample villages and spans socio-economic conditions, local infrastructure, social services, and development projects; and the structure and function of local governance.

    The PNDS-REP Baseline Survey incorporated both a Quantitative Baseline Survey (NBS) and a Qualitative Baseline Survey (LBS). The respective methodology and instruments were designed to complement each other. The NBS employed relatively short household and local leader surveys to collect data on economic, institutional, social and other factors across a relatively large sample. The LBS, on the other hand, employed semi-structured interviews and direct observation administered over a relatively long period within a relatively small sample to explore complex local governance and development processes.

    The qualitative survey covered 16 suku (villages) and was administered between February and August 2014. The quantitative survey covered 102 suku and was administered between June and August 2014.

    The follow-up surveys will cover the same villages as baseline surveys covered. The baseline surveys provide information that, when combined with data from follow-up surveys, may be used to construct before-and-after comparisons to indicatively assess the impacts of PNDS, the distribution of those impacts within and between villages, and analyze factors conditioning the level and distribution of impacts.

    Kind of Data

    Sample survey data [ssd]

    Unit of Analysis
    • individuals,
    • households,
    • villages

    Version

    Version Description

    v01
    Quantitative baseline datasets

    Version Date

    2015-02-18

    Scope

    Notes

    Quantitative Survey:

    • villages, hamlets and households general characteristics,
    • assets,
    • income and livelihoods,
    • food consumption,
    • agriculture,
    • roads,
    • irrigation,
    • drinking water,
    • sanitation,
    • electricity,
    • education,
    • health,
    • public works projects,
    • local governance,
    • conflict and social capital

    Qualitative Survey:

    • social cohesion,
    • formal and informal local institutions,
    • public goods and services

    Coverage

    Geographic Coverage

    National

    Producers and sponsors

    Primary investigators
    Name Affiliation
    Andrew Beath World Bank
    Yuhki Tajima Georgetown University
    Erin Steffen World Bank
    Prerna Chowdhury World Bank
    Miks Muizarajs World Bank
    Producers
    Name
    Government of Timor-Leste
    Australian Department of Foreign Affairs and Trade
    Funding Agency/Sponsor
    Name
    World Bank
    Other Identifications/Acknowledgments
    Name Role
    Catalpa International Programming of quantitative surveys, design of web interface, maintenance of the software

    Sampling

    Sampling Procedure
    1. The Quantitative Survey (NBS) was administered to a sample of 102 villages (suku) randomly selected from PNDS Phase-III villages, which in turn are a random sample of the 442 villages scheduled to be mobilized by PNDS but are the last of three batches of villages to be mobilized by PNDS. Within each of the 102 villages, two hamlets (aldeia) were randomly sampled and, in each of these two hamlets, eight households were randomly sampled.

    In each sample village and hamlet, questionnaires with Village Chief (Xefe Suku) and Hamlet Chief (Xefe Aldeia) surveys were administered, respectively. Within each sample hamlet, 8 households were selected through random sampling. The sampling of households was conducted in the field with the village or hamlet head. The sampling procedures consisted of three steps:

    • Access List of Households: In many cases, a list of households in the hamlet was available in the office of the Hamlet Chief or on a board outside the office. When a list of households was not readily available, the field team constructed a list of households in conjunction with the Hamlet Chief.
    • Numbering Households: If the list of households in the hamlet was not already numbered, the field team assigned a number to each household sequentially.
    • Random Sampling: The total number of households (N) was entered into a random number generator application installed on the electronic tablets used by the field team for data collection. The random generator produced a random sample of 12 integers between 1 and N (total number of households). The first eight households formed the primary sample households, while the next four households served as reserves.
    1. The Qualitative Survey (LBS) was administered to 16 villages sampled from among the 102 villages selected by the NBS. The 16 villages were sampled to provide balance across the following criteria: region, rural vs. peri-urban, intensity of conflict, veteran population and proximity to border.

    Within sample villages, respondents were selected using three sampling methods:

    • Purposive Sampling. A list of key stakeholders (e.g., Village Chief, Hamlet Chief, Ritual Leader, and the local Priest) was prepared prior to the arrival in each field site. Such stakeholders regularly participate in local governance activities and oversee local public works projects. Key respondents were interviewed in the earlier stages of data collection, with additional stakeholders identified and interviewed throughout the field visit.
    • Snowball Sampling. Additional respondents were identified based on referrals from key stakeholders throughout field visits.
    • Convenience Sampling. Research teams purposively selected easily accessible respondents and interviewed them at their houses or during community events. This sampling methodology was utilized in the final stages of the data collection cycle primarily to access marginalized villagers.

    Each method was executed at a different stage of a 12-day data collection cycle.

    Survey instrument

    Questionnaires

    Quantitative Baseline Survey (NBS)

    NBS consists of four different instruments:

    Male Household Questionnaire (MHQ): The MHQ collects information on basic household characteristics; health; crops, irrigation, and income; consumption and markets; projects and community; decision-making and governance; cohesion; subjective well-being and satisfaction with public services; and information, social, and human capital. The questionnaire was designed to survey the male head of household or, in the absence of such, a working-age male between 30-59 years old. A total 947 MHQs were administered across the 100 sample villages.

    Female Household Questionnaire (FHQ): The FHQ covers similar issues to the MHQ but also contains specific questions pertaining to maternal and child health. FHQs were administered to working age females between 30 and 59 years old and/or responsible for decisions regarding children in the household and/or day-to-day household activities. A total 1,114 FHQs were administered across the 100 sample villages.

    Youth and Elderly Questionnaire (YHQ): The YHQ is a shorter version of the MHQ and contained questions on development projects and satisfaction with public services, local decision-making, and subjective well-being. The YHQ covers youth aged between 15-29 years and elderly aged above 55 years who reside in sample households and were not surveyed by the MHQ or FHQ. A total of 166 youth and 84 elderly respondents were surveyed across the 100 sample villages.

    Village/Hamlet Chief Questionnaire (VC/HC-Q): The VC/HC-Q was administered to village and hamlet heads in the sample and ascertained information on village characteristics and the functions of chiefs. On average, one Village Chief and two Hamlet Chiefs were sampled in each village. However, one village contained only one hamlet and, in a number of villages, the village head was unavailable or refused to participate. In total, 198 Hamlet Chiefs and 95 Village Chiefs were interviewed.

    Qualitative Baseline Survey (LBS)

    LBS research instruments were developed to investigate the following narratives:

    1. Social Cohesion: The research instrument was designed to investigate volume and quality of interactions between villagers and to further explore sub-themes such as: identity, conflict and conflict mediation, power and vulnerability, development needs and priorities, village and hamlet borders, historical context and reoccurring social problems.

    2. Formal and Informal Local Institutions: The research instrument reviews defining processes occurring within villagelevel institutions, including local governance structures and community groups. The instrument further explored subthemes such as: leadership, power and decision making, financial management, collective action and communication strategies, and the creation and termination of village community groups.

    3. Public Goods and Services: The research instrument mapped the life-cycle and quality of public goods and services within the village and explored sub-themes such as: project selection and decision making processes, project planning, project implementation, resource management, and development outcomes.

    On average, research teams conducted 30 two-hour long semi-structured interviews per village.

    Data collection

    Dates of Data Collection
    Start End Cycle
    2014-02 2014-08 Qualitative baseline survey
    2014-06 2014-08 Quantitative baseline survey
    Data Collectors
    Name Affiliation
    Dili Institute of Business Quantitative data collection
    World Bank Qualitative data collection
    Data Collection Notes

    Quantitative Baseline Survey

    Quantitative data was collected between June 20, 2014 and August 15, 2014 in 100 villages in all 13 districts of Timor-Leste. Data collection was undertaken using a computer-assisted personal interviewing system using Open Data Kit (ODK), an open-source set of tools used to author, field, and manage mobile data collection solutions.

    Qualitative Baseline Survey

    LBS field visit lasted 12 days per village and was conducted by teams of two local researchers. LBS utilized the following data collection methods:

    1. Village Mapping: Upon arrival in the sampled village, a day-long mapping of village public works projects and institutions was completed. Using this information, an improvised map with coordinates of public facilities was designed.

    2. Semi-Structured Interviews: Teams conducted an average of 30 audio-recorded interviews per field study site. Using LBS Research Instruments, a list of 23 themes was developed. In addition, a LBS Question Guide contained sample questions for each theme. Paper-based interview notes were compiled after each interview. Overall, 554 respondents were sampled, of which 65 percent were male.

    3. Direct Observations: Research teams conducted direct observations of community meetings and events, public works construction processes, conflict mediation and other events within the village. For each observation, field notes were compiled, dated and assigned a theme.

    Data processing

    Data Editing

    Quantitative Baseline Survey

    Field staff members were issued Google Nexus tablets that contained electronic surveys. Completed surveys were sent from the field using 3G connectivity to a remote online server after each survey had been scrutinized by the team leader. A member of the PNDS-REP team in Dili checked incoming surveys and, if logical inconsistencies or any other faults in data quality were detected, contacted the relevant teams for further clarification or correction. The programming of surveys, design of web interface, and maintenance and upkeep of the software and server was outsourced to a private firm, Catalpa International.

    Qualitative Baseline Survey

    After each field visit, LBS research teams transcribed field notes, reviewed audio recordings, and developed a village report that incorporated qualitative data corresponding to the forementioned research themes. The village report incorporated the tools of process tracing and thick description. Process-tracing entails examining the step-by-step linkages that connect causes and effects of phenomena, with each step in the process is tested by examining various sources of data to ensure validity. Thick description was used as a data analysis tool, which involved reviewing field and interview notes and identifying recurring topics. Village reports were used as inputs to the analysis described in this report. Specifically, researchers utilized the cross-case data analysis method to formulate hypotheses and typologies.

    Depositor information

    Depositor
    Name Affiliation
    Andrew Beath World Bank

    Data Access

    Citation requirements

    The use of the datasets must be acknowledged using a citation which would include:

    • the identification of the Primary Investigator (including country name)
    • the full title of the survey and its acronym (when available), and the year(s) of implementation
    • the survey reference number
    • the source and date of download (for datasets disseminated online)

    Example:

    Andrew Beath, Erin Steffen, Prerna Chowdhury, Miks Muizarajs, World Bank; Yuhki Tajima, Georgetown University. Timor-Leste Programa Nasional Dezenvolvimentu Suku (PNDS) Research and Evaluation Program 2014, Quantitative and Qualitative Baseline Surveys. Ref. TLS_2014_PNDSIE-BL_v01_M. Dataset downloaded from [URL] on [date].

    Disclaimer and copyrights

    Disclaimer

    The user of the data acknowledges that the original collector of the data, the authorized distributor of the data, and the relevant funding agency bear no responsibility for use of the data or for interpretations or inferences based upon such uses.

    Contacts

    Contacts
    Name Affiliation Email
    Andrew Beath World Bank abeath@worldbank.org

    Metadata production

    DDI Document ID

    DDI_TLS_2014_PNDSIE-BL_v01_M_WB

    Producers
    Name Affiliation Role
    Development Data Group World Bank Study documentation
    Date of Metadata Production

    2015-07-06

    Metadata version

    DDI Document version

    v01 (July 2015)

    Back to Catalog
    IHSN Survey Catalog

    © IHSN Survey Catalog, All Rights Reserved.