Power Analysis Software for Educational Researchers

Thumbnail Image
If you need an accessible version of this item, please email your request to iusw@iu.edu so that they may create one and provide it to you.

Date

2010-10-31

Journal Title

Journal ISSN

Volume Title

Publisher

Abstract

Given the importance of statistical power analysis in quantitative research and the repeated emphasis on it by AERA/APA journals, we examined the reporting practice of power analysis by the quantitative studies published in 12 education/psychology journals between 2005 and 200910. It was surprising to uncover that less than 2% of the studies conducted prospective power analysis. Another 3.54% computed observed power, a practice not endorsed by the literature on power analysis. In this paper, we clarify these two types of power analysis and discuss functionalities of eight programs/packages (G*Power 3.1.3, PASS 11, SAS/STAT 9.3, Stata 12, SPSS 19, SPSS/Sample Power 3.0.1, Optimal Design Software 2.01, and MLPowSim 1.0 BETA) to encourage proper and planned power analysis. Based on our review, we recommend two programs (SPSS/Sample Power and G*Power) for general-purpose univariate/multivariate analyses, and one (Optimal Design Software) for hierarchical/multilevel modeling and meta-analysis. Recommendations are also made for reporting power analysis results and exploring additional software. The paper concludes with an examination of the role of statistical power in research and viable alternatives to hypothesis testing.

Description

Forthcoming in Journal of Experimental Education, Jan. 2012.

Keywords

statistical power analysis, prospective power, observed power, G*Power, PASS, Optimal Design Software, SAS, Stata, SPSS, Sample Power, MLPowSim, HLM

Citation

Peng, C.-Y. J., Long, H., Abaci, S. (2010). Power Analysis Software for Educational Researchers

DOI

Link(s) to data and video for this item

Relation

Rights

Type

Article