Citation

Ellis JL. Behav. Res. Methods 2013; 45(1): 16-24.

Copyright

(Copyright © 2013, Holtzbrinck Springer Nature Publishing Group)

DOI

10.3758/s13428-012-0223-z

PMID

unavailable

Abstract

Many authors adhere to the rule that test reliabilities should be at least .70 or .80 in group research. This article introduces a new standard according to which reliabilities can be evaluated. This standard is based on the costs or time of the experiment and of administering the test. For example, if test administration costs are 7 % of the total experimental costs, the efficient value of the reliability is .93. If the actual reliability of a test is equal to this efficient reliability, the test size maximizes the statistical power of the experiment, given the costs. As a standard in experimental research, it is proposed that the reliability of the dependent variable be close to the efficient reliability. Adhering to this standard will enhance the statistical power and reduce the costs of experiments.

Language: en