The Service Delivery Indicators ("the Indicators") provide a set of metrics for benchmarking service delivery performance in education and health in Africa to track progress across and within countries over time. The Indicators seek to enhance active monitoring of service delivery by policymakers and citizens, as well as to increase accountability and good governance. The perspective adopted by the Indicators is that of citizens accessing services and facing shortcomings.
The Service Delivery Indicators were piloted in Tanzania and Senegal in the spring/summer of 2010. The main objective of the pilots was to test the survey instruments in the field and to verify that robust indicators of service delivery quality could be collected with a single facility-level instrument in different settings. To this end, it was decided that the pilots should include an Anglophone and Francophone country with different budget systems. The selection of Senegal and Tanzania was also influenced by the presence of strong local research institutes from the AERC network: Centre de Recherche Economique et Sociale (CRES) in Senegal and the Research on Poverty Alleviation (REPOA) in Tanzania. Both research institutes have extensive facility survey experience and are also grantees of the Hewlett-supported Think Tank Initiative.
Kind of Data
Sample survey data [ssd]
Unit of Analysis
Shool facility, health facility
Scope
Notes
EDUCATION:
- Self-reported and administrative data on school characteristics, students, teachers and resource flows.
- Delays in the receipt of wages
- An unannounced visit about a weeks after the initial survey to measure the absence rates
- Based on 2 observed lessons for grade 4 in either English/French or math. Each observation lasts for 40 minutes
- Test of all (a maximum of 10) grade 3-4 teachers in mathematics language and pedagogy to measure teachers' knowledge.
- A test in math and language administered one-on-one to 10 randomly selected grade 4 students to measure learning achievement.
HEALTH:
- Self-reported and administrative data on health facility characteristics, staffing, and resources flows.
- Delays in the receipt of wages
- An unannounced visit about a week after the initial survey to measure the absence rates
- Time use per patient. Based on observations for two hours or at least of 15 patients.
- Test of 1-2 medical staff per facility to assess clinical performance.
Coverage
Geographic Coverage
National
Producers and sponsors
Primary investigators
Name
Centre de Recherche Economique et Sociale (CRES)
Producers
Name
World Bank
Funding Agency/Sponsor
Name
William and Flora Hewlett Foundation
Sampling
Sampling Procedure
the sample was designed to provide estimates for each of the key Indicators, broken down by urban and rural location. To achieve this purpose in a cost- effective manner, a stratified multi-stage random sampling design was employed.4 Given the overall resource envelope, it was decided that roughly 180 units would be surveyed in both sectors in Tanzania. The sample frames employed consisted of the most recent list of all public primary schools and public primary health facilities, including information on the size of the population they serve.
Final sample of facilities by sector:
Health Urban=135 Rural=40 Total=175
Education Urban=132 Rural=48 Total=180
Data Collection
Dates of Data Collection
Start
End
2010-04
2010-05
Data Collection Mode
Face-to-face [f2f]
Data Collection Notes
In collaboration with the in-country research partners, members of the technical team organized a one-week training session, which included three days of testing the instruments in the field. The enumerators and supervisors were university graduates, and in many cases were also trained health and education professionals (teachers, doctors, and health workers) with previous survey experience.
In Tanzania, data collection was carried out by 32 enumerators (16 in each sector) organized into 8 field teams (4 in each sector). Each team consisted of a team leader, 3 enumerators, and a driver. Four senior staff members from REPOA coordinated and supervised the fieldwork. Fieldwork in both education and health started in April 2010 and was completed within a month.
Questionnaires
Questionnaires
The survey used a sector-specific questionnaire with several modules (see below), all of which were administered at the facility level. The questionnaires built on previous similar questionnaires based on international good practice for PETS, QSDS, SAS and observational surveys. A pre-test of the instruments was done by the technical team, in collaboration with the in-country research partners, in the early part of 2010. The questionnaires were translated into Swahili for Tanzania.
EDUCATION:
- Module 1: Administered to the principal, head teacher or most senior teacher in the school
- Module 2: Administered to (a maximum of) 10 teachers randomly selected from the list of all teachers
- Module 3: Administered to the same 10 teachers as in module 2
- Module 4: Classroom observations
- Module 5: Test of teachers
- Module 6: Test of grade 4 children
HEALTH:
- Module 1: Administered to the in- charge or the most senior medical staff at the facility.
- Module 2: Administered to (a maximum of) 10 medical staff randomly selected from the list of all medical staff
- Module 3: Administered to the same 10 medical staff as in module 2
- Module 4: Health facility observations
- Module 5: Test of health workers. Patient case simulations.
Data Processing
Other Processing
All questionnaires collected during fieldwork were periodically brought from the field to the local partners' headquarters (in Dar es Salaam for REPOA) for verification and processing. In Tanzania, the data were processed by a team of five data entry operators and one data entry supervisor, and entered using CSpro. Data entry lasted 20 days commencing in late May 2010.
Disclaimer and copyrights
Disclaimer
The user of the data acknowledges that the original collector of the data, the authorized distributor of the data, and the relevant funding agency bear no responsibility for use of the data or for interpretations or inferences based upon such uses.