Progress in International Reading and Literacy Study 2006

PIRLS is a study of student achievement in reading comprehension in primary school, and is targeted at the grade level in which students are at the transition from learning to read to reading to learn, which is the fourth grade in most countries. The formal definition of the PIRLS target population makes use of UNESCO's International Standard Classification of Education (ISCED) in identifying the appropriate target grade:

"…all students enrolled in the grade that represents four years of schooling, counting from the first year of ISCED Level 1, providing the mean age at the time of testing is at least 9.5 years. For most countries, the target grade should be the fourth grade, or its national equivalent."

ISCED Level 1 corresponds to primary education or the first stage of basic education, and should mark the beginning of "systematic apprenticeship of reading, writing, and mathematics" (UNESCO, 1999). By the fourth year of Level 1, students have had 4 years of formal instruction in reading, and are in the process of becoming independent readers. In IEA studies, the above definition corresponds to what is known as the international desired target population. Each participating country was expected to define its national desired population to correspond as closely as possible to this definition (i.e., its fourth grade of primary school). In order to measure trends, it was critical that countries that participated in PIRLS 2001, the previous cycle of PIRLS, choose the same target grade for PIRLS 2006 that was used in PIRLS 2001. Information about the target grade in each country is provided in Chapter 9 of the PIRLS 2006 Technical Report.

Although countries were expected to include all students in the target grade in their definition of the population, sometimes it was not possible to include all students who fell under the definition of the international desired target population. Consequently, occasionally a country's national desired target population excluded some section of the population, based on geographic or linguistic constraints. For example, Lithuania's national desired target population included only students in Lithuanian-speaking schools, representing approximately 93 percent of the international desired population of students in the country. PIRLS participants were expected to ensure that the national defined population included at least 95 percent of the national desired population of students. Exclusions (which had to be kept to a minimum) could occur at the school level, within the sampled schools, or both. Although countries were expected to do everything possible to maximize coverage of the national desired population, school-level exclusions sometimes were necessary. Keeping within the 95 percent limit, school-level exclusions could include schools that:

• were geographically remote,
• had very few students,
• had a curriculum or structure different from the mainstream education system, or
• were specifically for students with special needs.

The difference between these school-level exclusions and those at the previous level is that these schools were included as part of the sampling frame (i.e., the list of schools to be sampled). Th ey then were eliminated on an individual basis if it was not feasible to include them in the testing.

In many education systems, students with special educational needs are included in ordinary classes. Due to this fact, another level of exclusions is necessary to reach an eff ective target population-the population of students who ultimately will be tested. These are called within-school exclusions and pertain to students who are unable to be tested for a particular reason but are part of a regular classroom. There are three types of within-school exclusions.

• Intellectually disabled students
• Functionally disabled students
• Non-native language speakers

Students eligible for within-school exclusion were identified by staff at the schools and could still be administered the test if the school did not want the student to feel out of place during the assessment (though the data from these students were not included in any analyses). Again, it was important to ensure that this population was as close to the national desired target population as possible. If combined, school-level and within-school exclusions exceeded 5 percent of the national desired target population, results were annotated in the PIRLS 2006 International Report (Mullis, Martin, Kennedy, & Foy, 2007). Target population coverage and exclusion rates are displayed for each country in Chapter 9 of the PIRLS 2006 Technical Report. Descriptions of the countries' school-level and within-school exclusions can be found in Appendix B of the PIRLS 2006 Technical Report.