Technical Methods Report: Statistical Power for Regression Discontinuity Designs in Education Evaluations

Technical Methods Report: Statistical Power for Regression Discontinuity Designs in Education Evaluations

Published: Aug 30, 2008
Publisher: Washington, DC: U.S. Department of Education, Institute of Education Sciences
Download
Authors

Peter Z. Schochet

This paper examines theoretical and empirical issues related to the statistical power of impact estimates under clustered regression discontinuity (RD) designs. The theory is grounded in the causal inference and HLM modeling literature, and the empirical work focuses on commonly used designs in education research to test intervention effects on student test scores. The main conclusion is that three to four times larger samples are typically required under RD than experimental clustered designs to produce impacts with the same level of statistical precision. The viability of using RD designs for new impact evaluations of educational interventions may be limited and will depend on the point of treatment assignment, the availability of pretests, and key research questions.

How do you apply evidence?

Take our quick four-question survey to help us curate evidence and insights that serve you.

Take our survey