The Two Errors of Using the Within-Subject Standard Deviation (WSD) as the Standard Error of a Reliable Change Index.

Abstract

In this Journal, Lewis and colleagues introduced a new Reliable Change Index (RCIWSD), which incorporated the within-subject standard deviation (WSD) of a repeated measurement design as the standard error. In this note, two opposite errors in using WSD this way are demonstrated. First, being the standard error of measurement of only a single assessment makes WSD too small when practice effects are absent. Then, too many individuals will be designated reliably changed. Second, WSD can grow unlimitedly to the extent that differential practice effects occur. This can even make RCIWSD unable to detect any reliable change.