Addressing omitted prior achievement bias in international assessments: an applied example using PIRLS-NPD matched data

Daniel H. Caro, Leonidas Kyriakides, Ioulia Televantou

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Omitted prior achievement bias is pervasive in international assessment studies and precludes causal inference. For example, reported negative associations between student-oriented teaching strategies and student performance are against expectations and might actually reflect omitted prior achievement bias. Namely, that these teaching strategies are negatively correlated with unobserved prior achievement performance, because teachers offer more support to lower performing students, and not that these strategies cause lower performance. This paper examines omitted prior achievement bias in teaching effects with prior achievement data available for students in England participating in the Progress in International Reading Literacy Study. Further, it proposes an analytical approach to account for omitted prior achievement bias in international estimates. The paper argues that the bias is not simply a technical artefact, but reflects educational mechanisms unobserved in international assessment studies, which can be captured with matched assessment data-sets or with evidence from previous studies. Estimates of these mechanisms can be used to postulate scenarios of the bias across education systems and thereby adjust international estimates of teaching effects as if prior achievement were observed. Potentials and limitations of this approach for studying educational effectiveness with international assessment data are discussed.

Original languageEnglish
Pages (from-to)1-23
Number of pages23
JournalAssessment in Education: Principles, Policy and Practice
DOIs
Publication statusAccepted/In press - 4 Oct 2017

Keywords

  • international large-scale assessments
  • National Pupil Database
  • Omitted prior achievement bias
  • PIRLS
  • reading performance
  • teaching strategies

Fingerprint Dive into the research topics of 'Addressing omitted prior achievement bias in international assessments: an applied example using PIRLS-NPD matched data'. Together they form a unique fingerprint.

  • Cite this