Effects of Item Positions on Their Difficulty and Discrimination: A Study in PISA Science Data Across Test Language and Countries

Type Working Paper - ACEReSearch
Title Effects of Item Positions on Their Difficulty and Discrimination: A Study in PISA Science Data Across Test Language and Countries
Author(s)
Publication (Day/Month/Year) 2007
URL http://research.acer.edu.au/cgi/viewcontent.cgi?article=1001&context=pisa
Abstract
This study was based on a four-cluster rotation design of 13 linked test booklets from PISA 2006 science data. It investigated effects of item positions on their difficulty and discrimination parameter estimates obtained from one and twoparameter IRT Partial Credit models. The analyses were done separately for 57 test language groups from 53 countries with a total of about 340,000 students. The results revealed that for all of the test language groups the items tended to become more difficult when they were located later in the test. However, a high linear relationship between the item difficulty estimates by the four cluster locations was found. Moreover, open-ended items seemed to show more change than items in other formats. There were small variations in the cluster locations for the item point-biserial discrimination and the item discrimination pa

Related studies

»