Learning Resources

Leadscape is now accepting applications!. Download the application (PDF).

Find out what we’ve been up to! Download the Quarterly Report here!

New Project Forum report on Principal Preparedness to Support Diverse Learners

ability abridged accommodations accuracy action activities administrators adolescent alliance alternate america applies asian assistance attitudes author background blind building characteristics coaching cognitive collaborative collection compared comprehensive conditions connections content context continuing copied council counselors creating critical current database decision describes determine developmental discrimination disorders disparities disproportionality distribution documents download economic efforts emailed emotional engagement ensure environment equalization equitable exceptional expectations explores express factors focus focuses framework funding future gender general gifted governance graduation handbook handouts health helping higher hispanic holder human identity immigrant impact implementation implications important income increasing indicator inequality influence initiative inquiry institute integration interactions international intervening involvement justice kindergarten knowledge large latino leaders lessons listserv local longitudinal making management material matters means mental methods monitoring multicultural multiple number offers organization original paper peers people perceptions permission personal perspectives planning population posted postsecondary poverty power powerpoints preparation preschool prevention print problem process proficiency progress project promoting property psychology psycinfo published questions rates readiness recommendations record reduce refer reflective related relationship requirements retardation selected series serve settings significant sites skills slide society socioeconomic specific start statistics status stereotype structure struggling suggests survey teams technical technology topical total training trends universal users version warranty working writing written years young youth

Report: Statistical Power Analysis in Education Research

Report » Statistical Power Analysis in Education Research

pdf

Categories

RESEARCH, DATA, EDUCATION

Areas

PRACTITIONER:group practice and professional learning

Authors

Larry V. Hedges , Christopher Rhoads

Published

2010, 4/28/2010

Publisher

National Center for Special Education Research, Institute of Education Sciences, U.S. Department of Education

Abstract

This paper provides a guide to calculating statistical power for the complex multilevel designs that are used in most field studies in education research. For multilevel evaluation studies in the field of education, it is important to account for the impact of clustering on the standard errors of estimates of treatment effects. Using ideas from survey research, the paper explains how sample design induces random variation in the quantities observed in a randomized experiment, and how this random variation relates to statistical power. The manner in which statistical power depends upon the values of intraclass correlations, sample sizes at the various levels, the standardized average treatment effect (effect size), the multiple correlation between covariates and the outcome at different levels, and the heterogeneity of treatment effects across sampling units is illustrated. Both hierarchical and randomized block designs are considered. The paper demonstrates that statistical power in complex designs involving clustered sampling can be computed simply from standard power tables using the idea of operational effect sizes: effect sizes multiplied by a design effect that depends on features of the complex experimental design. These concepts are applied to provide methods for computing power for each of the research designs most frequently used in education research.

Files