| Table of contents |
Acknowledgements ............................................................................................... 1
Table of Tables ...................................................................................................... 5
Table of Figures ..................................................................................................... 5
List of Acronyms .................................................................................................... 6
Executive Summary ............................................................................................... 8
1. Introduction ................................................................................................ 13
1.1 Evaluation Method ................................................................................... 14
1.2 Report Organisation .................................................................................. 15
2. Common methodological considerations for CS/INP evaluations .................. 17
2.1 Qualitative methods ................................................................................. 17
2.2 Quantitative methods ............................................................................... 19
One-Group, Pre-test/Post-test, Model-Based Design .................................... 19
Using a Model-Based Approach ..................................................................... 21
Model I: Treating selection bias ..................................................................... 25
Model II: Identification strategy through duration of assimilation ............... 27
Model III: Production-side considerations ...................................................... 27
Model IV: Testing for convergence ................................................................ 28
Analysis of gender issues ............................................................................... 28
Using Other Multivariate Techniques ............................................................ 29
3. Conservancy Support Activity ...................................................................... 31
3.1 Activity Overview ...................................................................................... 31
3.2 Evaluation Questions Being Addressed .................................................... 35
3.3 Analytic Specification ................................................................................ 37
Tying research questions to CTV models........................................................ 37
Construction of impact indicators and covariates ......................................... 47
Analysis of NRM and institutional development technical assistance ........... 50
3.4 Data Sources ............................................................................................. 53
3.5 Qualitative Analysis ................................................................................... 55
4. The INP Support Activity .............................................................................. 59
4.1 Activities Overview ................................................................................... 59
Support to PPOs ............................................................................................. 60
4.2 Evaluation Questions Being Addressed .................................................... 64
4.3 Evaluation Design ...................................................................................... 65
Who and what is being evaluated? ............................................................... 65
Evaluation logic and its common design elements ........................................ 68
Evaluation-specific design elements .............................................................. 73
4.4 Analysis of Research Questions ................................................................ 74
Tying research questions to CTV models........................................................ 80
Construction of impact indicators and covariates ......................................... 81
Dealing with external validity ........................................................................ 82
4.6 Data Sources ............................................................................................. 83
4.7 Qualitative Analysis ................................................................................... 85
5. The Implementation Plan............................................................................. 89
5.1 Phase 2: Evaluation Implementation, Management and Analysis ........... 89
5.2 Phase 3: Communication and Finalisation ................................................ 90
6. Risk Assessment .......................................................................................... 91
6.1 Data Acquisition ........................................................................................ 91
6.2 Respondent Access and Honesty .............................................................. 91
6.3 Sampling assumptions .............................................................................. 92
6.4 Timing ........................................................................................................ 92
Annex A. Literature review .................................................................................. 93
Annex B. PPOs and their INPs ............................................................................ 101
Annex C. Examples of tourism indicator ............................................................. 105
Annex D. Indicator construction for measuring outcomes .................................. 107
Annex E General model for analysis of gender issues ......................................... 109
Annex F Choosing the best source for governance data ...................................... 111 |
