| Table of contents |
EXECUTIVE SUMMARY ........................................................................................................................ I
1. INTRODUCTION AND BACKGROUND ...................................................................................... 1
A. COUNTRY CONTEXT ......................................................................................................................... 1
B. OBJECTIVES OF THIS REPORT ........................................................................................................... 1
2. OVERVIEW OF THE COMPACT AND THE INTERVENTIONS EVALUATED .................. 2
A. OVERVIEW OF PROJECT AND IMPLEMENTATION ............................................................................. 2
i. Project Description .................................................................................................................................... 2
ii. Project Stakeholders, Beneficiaries and Implementers .............................................................................. 4
iii. Geographic Coverage................................................................................................................................. 6
iv. Description of Implementation to Date ...................................................................................................... 6
B. COST BENEFIT ANALYSIS AND BENEFICIARY ANALYSIS .............................................................. 15
C. LITERATURE REVIEW ..................................................................................................................... 15
i. Summary of land and land-use change challenges in Indonesia .............................................................. 15
ii. Gaps in literature ..................................................................................................................................... 18
iii. Policy relevance of the evaluation ............................................................................................................ 19
3. EVALUATION DESIGN ................................................................................................................ 20
A. EVALUATION PURPOSE AND QUESTIONS ....................................................................................... 20
B. EVALUATION DESIGN OVERVIEW .................................................................................................. 23
i. Methodology ............................................................................................................................................. 23
ii. Qualitative Data Collection ...................................................................................................................... 28
iii. Sampling ................................................................................................................................................... 32
iv. Development of the Sampling Frame........................................................................................................ 33
v. Sampling of Areas, Key Informants and FGD Participants ..................................................................... 34
vi. Gender Strategy ........................................................................................................................................ 36
C. LIMITATIONS AND THREATS TO VALIDITY .................................................................................... 37
4. ADMINISTRATIVE ........................................................................................................................ 39
A. SUMMARY OF IRB REQUIREMENTS AND CLEARANCES .................................................................. 39
B. DATA PROTECTION AND PREPARATION OF DATA FILES FOR ACCESS, PRIVACY AND DOCUMENTATION ................................................................................................................................... 39
C. DISSEMINATION PLAN .................................................................................................................... 39
D. EVALUATION TEAM ROLES AND RESPONSIBILITIES ...................................................................... 40
E. EVALUATION TIMELINE AND REPORTING SCHEDULE ................................................................... 40
REFERENCES .......................................................................................................................................... 43
ANNEX 1: EVALUATION DESIGN CHANGES (NOVEMBER 2019) ............................................. 44
A. OVERVIEW OF THE COMPACT AND THE INTERVENTIONS EVALUATED ......................................... 44
i. Project Description .................................................................................................................................. 44
ii. Project Stakeholders and Beneficiaries .................................................................................................... 48
B. OVERVIEW OF THE PROJECT AND IMPLEMENTATION .................................................................... 48
i. Theory of Change ..................................................................................................................................... 48
C. EVALUATION DESIGN .................................................................................................................... 50
i. Evaluation Purpose and Questions .......................................................................................................... 50
ii. Evaluation Design Overview .................................................................................................................... 52
iii. Methodology ............................................................................................................................................. 53
iv. Addressing indications of long-term outcomes in the interim evaluation reports .................................... 62
v. Data Collection ........................................................................................................................................ 63
vi. Document Review and Secondary Data.................................................................................................... 63
vii. Qualitative Data ....................................................................................................................................... 67
viii. Sampling .............................................................................................................................................. 68
D. ADMINISTRATIVE ........................................................................................................................... 77
i. Clearance Requirements ........................................................................................................................... 77
ii. Dissemination Plans ................................................................................................................................. 77
iii. Evaluation Team Roles and Responsibilities ............................................................................................ 78
iv. Evaluation Timeline and Reporting Schedule .......................................................................................... 78
ANNEX 2: EVALUATION DESIGN MATRIX .................................................................................... 81
ANNEX 3: EVALUATION BUDGET .................................................................................................... 82
ANNEX 4: COMMENT MATRIX .......................................................................................................... 83 |
