Off-Grid Energy Access 2019, Independent Evaluation
Benin, 2019 - 2020
Get MicrodataIdentification
BEN_2019_MCC-OGEA_v01_M
Off-Grid Energy Access 2019
Independent Evaluation
| Name | Country code |
|---|---|
| Benin | BEN |
The evaluation of OGEAP has two main components. The first is a more qualitative performance evaluation of the Enabling Environment Activity and the OCEF grant facility functioning (as a facility or mechanism, rather than looking at results of individual grants). The second component is a more quantitative impact evaluation centered on a collection of grants.
Exposure to treatment
The impact evaluation samples households or businesses randomly from the lists of only those customers signing up for new connections from the grantees, and collects baseline and follow-up data from these individuals. Such lists will need to be obtained promptly from grantees once new customers are identified, and surveys will need to be deployed rapidly to collect baseline data, prior to connections being installed (baseline surveying will need to occur on a rolling basis).
Control zones will be oversampled at baseline, to allow ex post matching from a representative sample of households or businesses in control communes to those actually signing up to receive connections in treatment zones. This approach requires a larger sample of controls at baseline but would allow a full panel analysis of households and businesses for the matched sample of observations. Importantly, treatment is defined at the household or business level in this approach for Windows 2 and 3, and probably at the community level (given that the investments there are for public services) for Window 1. (The appropriate level of assignment for Window 4 is currently unclear.)
Version
- v01: Edited, anonymous dataset for public distribution.
Scope
| Topic | Vocabulary |
|---|---|
| Energy | MCC Sector |
Coverage
National coveage
Study populations are:
Impact Evaluation:
- Households, businessess, and communities sampled for the evaluation of OCEF grants: these are households, businessess, and communities (including those in rural and off-grid areas) which are targeted as customers by OCEF grant recipients. The control population are equivalent entities in control (non-treated) communities which will be matched ex-post
- OCEF grant beneficiaries
Performance Evaluation:
- OCEF grant beneficiaries
- Other private sector off-grid energy firms (including those who at least initiated an application for OCEF funding in Calls 1 and/or 2, and those who completed an application but where not shortlisted)
- Other key stakeholders involved in or knowledgeable about OCEF, including representatives from: MCC, MCA, NIRAS, IED, the Government of Benin (eg, ARE, ABERME), and other stakeholding entities (e.g, EU, World Bank, GiZ)
Producers and sponsors
| Name |
|---|
| Social Impact |
| Name |
|---|
| Millennium Challenge Corporation |
Sampling
HOUSEHOLD SURVEY:
The subcontractor will conduct a Household Listing in selected clusters in half of the total number of communities. Because the communities and their populations are not known at this point, it is not known how many households will be listed.
However, from this list, 3168 households will be sampled, representing 75% of the total number of baseline households to be surveyed. In the other half of communities, a full list of targeted respondents will be drawn from grantees’ customer sign-up lists from which to sample the remaining 1056 households, for a total baseline sample of 4224: 3168 control households and 1056 treatment households to which to administer the Household Survey.
At endline, 1056 of the 3168 baseline control households will be matched ex-post to the 1056 treatment households, for a total endline sample size of 2112.
VILLAGE ENTERPRISE SURVEY:
In each community in which the household survey is being conducted, a Village Enterprise Llisting will also be conducted using the same methodology. 10 enterprises will be sampled per community to be surveyed using the Village Enterprise Survey: this is a minimum of 600 enterprises (in 60 communities) and a maximum of 1200 enterprises (in 120 communities).
COMMUNITY SURVEY:
In each community in which the household survey is being conducted, a Community Survey will be administered to one knowledgeable person in the community (e.g. village leader, teacher, etc).
APPLICANT SURVEY:
60 off-grid energy sector firms operating in West Africa will be selected for the pplicant Survey, representing: firms that were shortlisted for OCEF funding and received technical assistance under the program, firms that submitted an OCEF application but were not shortlisted, and firms that registered interest in OCEF but did not submit an application.
QUALITATIVE DATA COLLECTION
At least two firms from each of the categories listed for the Applicant Survey will also be selected to participate in Focus Group Discussions for the performance evaluation. In addition, specific individuals will be selected for Key Informant Interviews to support the same. Lastly, Focus Group Discussions with community members in support of the quantitative data used for the impact evaluation is also planned, although details are not available right now.
Survey instrument
Questionnaires were developed in English, and will be translated into French. After an initial review the questionnaires will be translated back into English by an independent translator with no prior knowledge of the survey. The back translation from the French version will be independently reviewed and compared to the English original, and differences in translation will be reviewed and resolved in collaboration with the original translators.
The French questionnaires will be piloted as part of the survey pretest. In addition, a strategy for translating questionnaires into local languages will be reviewed with data collection teams during training.
- APPLICANT SURVEY:
This survey includes modules on: respondent characteristics, organization/firm characteristics, cxperience with the OCEF Application and grantee selection process, perceptions of the off-grid sector in Benin and applications, off-grid energy and/or energy efficiency projects and experience, (possibly) a discrete choice experiment, challenges facing the organization, general organization performance, off-grid activity inputs and costs, and energy ffficiency and off-grid profits.
The Applicant Survey is to be administered to the following types of respondents:
a) if the firm did not submit a complete OCEF application, someone familiar with off-grid interventions or ventures of the firm, and preferably who started and/or could have completed this type of application had the firm decided to apply
b) If firm did submit a complete OCEF application but was not selected or has a pending application, someone who is familiar with the application and who is otherwise familiar with off-grid interventions or ventures of the firm
c) If firm did submit a complete OCEF application and was selected, someone who is familiar with the application process and who is otherwise familiar with off-grid interventions or ventures of the firm
-
HOUSEHOLD SURVEY
This survey is to be administered to sampled households in treatment and control areas, and includes modules on: household characteristics, perceptions of energy situation and electrification status, household electricity status (and supply and demand), energy usage, daily habits (time usage and preferences), willingness to pay for a connection, health information, socioeconomic variables, use and perceptions of public services and businesses, and questions on women's empowerment for female heads of household or female spouses of the household head. -
(VILLAGE) ENTERPRISE SURVEY
This survey is to be administered to sampled enterprises in treatment and control areas, and includes modules on: respondent characteristics, basic business information, perceptions of energy situation, electricity status and supply and demand, other energy sources and uses, assets, general business performance, business inputs and costs, business outputs/revenues/profits, and time preference and risk. Control group respondents will also be asked questiosn about their willingness to pay for off-grid electricity solution -
COMMUNITY SURVEY
This survey is to be administered to a knowledgable person in the village (e.g. village leader), and includes modules on: basic village information, village energy situation, and public services.
Data collection
| Start | End | Cycle |
|---|---|---|
| 2019-04 | 2020-01 | Baseline |
Access policy
Millennium Challenge Corporation
Millennium Challenge Corporation
https://data.mcc.gov/evaluations/index.php/catalog/241
Cost: None
Data Access
Use of the dataset must be acknowledged using a citation which would include:
- the Identification of the Primary Investigator
- the title of the survey (including country, acronym and year of implementation)
- the survey reference number
- the source and date of download
Contacts
| Name | Affiliation | |
|---|---|---|
| Millennium Challenge Corporation | US Government | opendata@mcc.gov |
Metadata production
DDI_BEN_2019_MCC-OGEA_v01_M
| Name | Role |
|---|---|
| Millennium Challenge Corporation | Review of Metadata |
2020-06-05
Metadata version
Version 01
Version 2.0 (June 2020). Edited version based on Version 01 (DDI-MCC-BEN2-ENERGY-OFFGRID-SI-2019-V1) that was produced by the Millennium Challenge Corporation.