HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Abstract Full Text (PDF) The Bottom Line All Versions of this Article: ptj.20060101v1 87/2/170    most recent Submit a response Alert me when this article is cited Alert me when Rapid Responses are posted Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Fritz, S. L Articles by Light, K. E Search for Related Content PubMed PubMed Citation Articles by Fritz, S. L Articles by Light, K. E Related Collections Adaptive/Assistive Devices Therapeutic Exercise Stroke (Neurology) Tests and Measurements Stroke (Geriatrics) Social Bookmarking                      What's this?

Participant Perception of Recovery as Criterion to Establish Importance of Improvement for Constraint-Induced Movement Therapy Outcome Measures: A Preliminary Study

SL Fritz, PT, PhD, is Clinical Assistant Professor, Physical Therapy Program, Department of Exercise Science, University of South Carolina, 1300 Wheat St, Blatt PE Bldg, Columbia, SC 29208 (USA)
SZ George, PT, PhD, is Assistant Professor, Department of Physical Therapy, College of Public Health and Health Professions, Brooks Center for Rehabilitation Studies, University of Florida, Gainesville, Fla
SL Wolf, PT, PhD, FAPTA, is Professor, Center for Rehabilitation Medicine, Emory University School of Medicine, Atlanta, Ga
KE Light, PT, PhD, is Associate Professor, Department of Physical Therapy, College of Public Health and Health Professions, University of Florida

Address all correspondence to Dr Fritz at: sfritz{at}gwm.sc.edu

Submitted March 29, 2006; Accepted September 25, 2006

	Abstract

 
Background and Purpose: Changes in function following constraint-induced movement therapy (CIMT) are characterized primarily by improvements in performance; however, the importance of these outcome measures to the participant may be unclear. The primary purpose of this study was to determine whether either change scores or raw follow-up scores for the Motor Activity Log amount scale (MALa) and the Wolf Motor Function Test (WMFT) predicted participants' self-reports of recovery of upper-extremity function at 4 to 6 months after starting CIMT.

Subjects and Methods: This study was a secondary analysis of a cohort of subjects (N=46) who participated in CIMT trials. Subjects completed measures at baseline and 4 to 6 months later. Hierarchical regression models determined whether change scores or raw follow-up scores of CIMT outcome measures were predictive of perceived recovery. Receiver operating characteristic (ROC) curves determined cutoff scores for measures that significantly contributed to participants' reports of perceived recovery.

Results: The regression models indicated that raw follow-up MALa scores (ß=0.80, P=.024) and WMFT scores (ß=–0.37, P=.03) contributed to perceived recovery. Proposed cutoff scores for the MALa scores were less than 1.15 (negative likelihood ratio [LR]=0.17) for predicting less than 50% recovery and greater than 2.50 (positive LR=2.75) for predicting 50% or greater recovery. Proposed cutoff scores for follow-up WMFT scores were greater than 34.0 seconds (negative LR=0.24) for predicting less than 50% recovery and less than 11.0 seconds (positive LR=5.96) for predicting 50% or greater recovery.

Discussion and Conclusion: Raw follow-up scores for the MALa and WMFT were better predictors of self-report of recovery in comparison with change scores. These data also serve as a starting point for developing cutoff scores that accurately predict self-report of recovery.

	Introduction

Top Abstract Introduction Method Results Discussion Conclusions References

 
The number of people who have survived a stroke has almost doubled over the last 25 years^1,2 and is predicted to double again over the next 50 years.³ Currently, stroke is the leading cause of disability in the United States³ and costs the American public more than $43 billion per year.^4,5 More than half⁴ of the 4.7 million people who have survived a stroke³ have residual motor disability, and of these, 30% to 66% have a nonfunctional paretic arm.⁵ Undeniably, rehabilitative strategies aimed at reducing stroke-related disabilities are important to this growing population. Currently, few traditional rehabilitation methods have been proven effective for the treatment of the upper-extremity (UE) in people who have survived a stroke.⁶

Constraint-induced movement therapy (CIMT), however, is reported to significantly improve functional use of the UE in 20% to 25% of people with chronic stroke disability.¹ The goal of CIMT is to overcome learned nonuse by increasing the functional use of the neurologically weaker UE through massed practice, while restraining the lesser-involved UE.¹ Originally tested in an animal model, the results of CIMT studies have demonstrated significant and lasting improvements of UE movement function.^1,2,6–14

Changes in function following CIMT are characterized primarily by changes in performance or perceived changes on assessment instruments. These mean change scores may demonstrate statistically significant results, especially when larger samples are used. The importance of statistically significant findings, however, can be unclear. One approach to examine the meaningfulness of scores is by comparing outcomes with an established external criterion^15,16 such as validated outcome questionnaires or health care practitioner perceptions of recovery.^15,17–22 Another external criterion to consider is the patient's perspective, which is important because the patient's perspective may differ from the practitioner's perspective or from a questionnaire. The patient has been described as the final arbiter of how well or how poorly a particular intervention is working.²³ This "patient-centered" paradigm has been advocated for in physical therapist practice guidelines²⁴ and utilized in pain studies^25–27; however, this topic has not been extensively investigated in stroke rehabilitation. Given that recovery of UE function following stroke is an individual process, there would appear to be value in determining whether commonly used CIMT outcome measures are associated with patient self-reports of UE recovery.

Outcomes following CIMT have been assessed with multiple outcome measures. Standardized assessment tools such as the Wolf Motor Function Test (WMFT)^28,29 and the Motor Activity Log (MAL)^30,31 quantify changes following CIMT. They have not been compared, however, with an external criterion based on patient perception of recovery. The purposes of this study were: (1) to determine whether change scores or raw follow-up scores on the MAL and WMFT predicted perceived recovery of the UE as measured by the perceived recovery section of the Stroke Impact Scale and (2) to calculate cutoff values that predicted perceived recovery of the UE for the appropriate MAL and WMFT measures.

	Method

Top Abstract Introduction Method Results Discussion Conclusions References

 
CIMT Data Collection

This secondary analysis is from a convenience sample of 46 participants who participated in 2 local CIMT projects. These participants met specific inclusion and exclusion criteria (Tab. 1).³² First, the participants signed an institutional review board–approved informed consent statement. After a pretest, participants received 2 weeks (10 consecutive weekdays) of supervised task practice using their affected hand and arm for 6 hours per day. For this period, the unaffected hand was immobilized in a padded mitt for a goal of 90% of their waking hours. An activity log was kept by the trainer to chronicle what tasks had been attempted and how the tasks were progressed during training. The CIMT consisted of a set of tasks such as picking up pencils, moving beans between containers, and stacking items. The treatment was focused on frequent movement repetitions while performing functional activities. To remain challenging, as performance improved, tasks were increased in complexity and difficulty. This was accomplished by adding a time component, increasing the degrees of freedom, incorporating multijoint tasks, increasing the height or distance in which the task was performed, or increasing the number of choices or the pattern complexity.

Instrumentation

Predictors
Two main outcome measures, commonly reported in CIMT studies, were used for this study: (1) the amount component of the MAL (MALa), a test of perceived use, and (2) the WMFT, a test of movement capability. The MAL, a commonly used CIMT outcome measure,^1,9–11,33 is a 30-question, structured interview in which the participants respond with a number corresponding to a given amount of use or perception of how well they have used their affected arm when away from the laboratory environment. For example, a participant would respond to the question "How much do you use your more affected arm to turn on a light switch?" by choosing the appropriate response from the MALa (Tab. 2). Only the mean of the "amount" section of the MAL was used as an outcome measure for this analysis. The internal consistency of the MAL is relatively stable, and the reproducibility of the MAL is sufficient to detect an individual change of less than 1.0 on the scale.³¹

Covariates
The following variables previously were found to be predictive of follow-up outcomes for CIMT^34–36 and, therefore, were included as covariates in the model to account for individual differences of participants prior to the intervention. The UE motor component of the Fugl-Meyer Sensorimotor Assessment was used as a covariate in the MALa model.³⁶ It is a measure of the percentage of recovery of a person following a stroke that provides a quantifiable measurement of motor function and was designed primarily for use in rehabilitation settings. The UE motor component of the Fugl-Meyer test is a measure of a person's ability to move in and out of synergy, reflexes, wrist stability, grasping ability, and coordination.³⁷

For the WMFT model, the ability to open the involved hand was used as a covariate.³⁴ This covariate was defined as the ability to actively release a mass flexion grasp as defined by Fugl-Meyer assessment. This 0 to 2 scale is graded as follows: a score of 0 was given if the individual was unable to release the grasp, a score of 1 was given if the participant could release the mass flexion grasp, and a score of 2 was given if the participant could fully extend the fingers from the starting grasp position.³⁸

External Criterion

The external criterion used for this study was the perceived recovery section of the Stroke Impact Scale³⁹ taken at the follow-up test. The participants rated their perceived recovery of their more affected hand and arm since the stroke. This is rated by the individual on a scale of 0 to 100, with 100 corresponding to full recovery and 0 corresponding to no recovery. The use of a participant-based questionnaire as an external criterion has not been widely reported in stroke rehabilitation, but this method is similar to that implemented in other rehabilitation populations in which the respondent's perception of recovery was used as an external criterion.^{15,17–20,40} For the purposes of this study, we dichotomized patients into 50% (50% or greater perception of recovery in more-affected UE), and <50% (less than 50% perception of recovery in more-affected UE) groups.

Data Analysis

All data analyses were performed with the SPSS software program, version 12.0.^* First, descriptive statistics were generated for each measure. Kolmonorov-Smirnov tests were used to assess whether the data for each measure approximated a normal distribution and whether transformations of the measures of interest were necessary before being included in the regression models. The following data analyses then were performed to address the specific purposes of this study.

Prediction of outcome (purpose 1)
Simultaneous regression models determined whether MALa and WMFT scores contributed to perceived recovery ratings 4 to 6 months after starting CIMT. The first regression model included age, Fugl-Meyer UE motor component score, change in MALa scores over 4 to 6 months, and raw follow-up MALa score. The rationale for including age and the Fugl-Meyer UE motor component score was that these variables were previously found to be predictive of follow-up MALa scores for CIMT.³⁵ The second regression model included the ability to open the involved hand (Fugl-Meyer test item), follow-up (4–6 months) change in WMFT score, and raw follow-up WMFT score. The rationale for including the ability to open the involved hand was that this variable was previously found to be predictive of WMFT scores for CIMT.³⁴

The change and raw MALa and WMFT scores were simultaneously entered into the regression model to determine which measure was most appropriate for determining a clinically meaningful outcome at follow-up. Variance inflation factor (VIF) was reported to assess whether excessive collinearity was a concern by having change and raw scores for the predictor variables in the regression model. The VIF expresses the degree to which collinearity among the predictors degrades the precision of the regression estimate. Theoretically, VIF estimates range from 1 to infinite, with larger numbers being more indicative of collinearity. Practically, a VIF value greater than 10 indicates that the predictor variable has a strong linear association (r>.95) with other predictor variables included in the regression model.⁴¹

Calculation of cutoff scores (purpose 2)
Cutoff scores were calculated only for individual measures that contributed to perceived recovery ratings at P<.10. We used a liberal criterion for selecting measures for cutoff scores because we wanted to avoid eliminating potentially useful measures at this stage of the analysis. First, receiver operating characteristic (ROC) curves assessed whether the measure accurately predicted subjects with self-reports of 50% or greater perceived recovery since the time of their stroke.^42,43 The ROC curve was generated by considering each individual point of the selected measure as a potential cutoff for distinguishing between subjects who reported 50% or greater perceived recovery and those who did not. The predictive performance of each individual point is then plotted on a graph with the y-axis representing the true positive rate and the x-axis representing the false positive rate. The ROC curve is generated when the individual points are connected, giving an overall estimate of the predictive accuracy of the selected measure.

A common way to summarize findings from an ROC curve is to report the amount of area under the ROC curve (AUC). The expected range of AUC scores is from 0.5 (no better than chance identification of outcome of interest) to 1.0 (perfect identification of outcome of interest).^44,45 In this study, the AUC (and corresponding 95% confidence interval [CI]) was calculated with a nonparametric method that did not require normal distribution of perceived recovery ratings.⁴⁶ The AUC for this study can be interpreted as the probability the selected measure has in identifying CIMT participants who rated perceived recovery at 50% or greater at follow-up.

After the ROC curves were generated, cutoff scores were calculated for each measure that explained more than 50% AUC based on the lower bound of 95% CI. This criterion was selected because it indicated that the measure likely predicted improved status at better than chance rates. Individual points were considered for cutoff scores by visually inspecting the ROC curve to identify points associated with maximal true positive and minimal false positive rates. These candidate points were further investigated by calculating sensitivity (Sn), specificity (Sp), and likelihood ratios (LR) for each potential cutoff score. For each point, Sn was determined by calculating the true positive rate, Sp was determined by calculating the false positive rate, the positive LR was calculated by dividing the Sn by (1 – Sp), and the negative LR was calculated by dividing (1 – Sn) by the Sp.⁴⁷

The decision on which specific cutoff score was reported in the manuscript was based on the following criteria. First, we wanted to generate a cutoff score that accurately identified participants rating their perception of UE recovery at less than 50%. This cutoff score was determined by selected the individual point that minimized the negative LR, or the ratio of false negatives to true negatives. Therefore, the negative LR that resulted in the smallest value was selected as a cutoff score that could potentially identify participants rating their perception of UE recovery at less than 50%. Second, we wanted to generate a cutoff score that accurately identified participants rating their perception of UE recovery at 50% or greater. This cutoff score was determined by selecting the individual point that maximized the positive LR, or the ratio of true positives to false positives. Therefore, the positive LR that resulted in the largest value was selected as a cutoff score that could potentially identify participants rating their perception of UE recover at 50% or greater. Although these analytical techniques have not been widely reported in the stroke literature, similar techniques have been reported previously to determine cutoff scores in the rehabilitation literature.^21,22

	Results

Top Abstract Introduction Method Results Discussion Conclusions References

 
The descriptive statistics are reported in Table 3. The distribution of each CIMT outcome measure (change and follow-up scores) used in the regression analyses approximated a normal distribution by Kolmonorov-Smirnov tests (P>.05). Therefore, no data transformations were performed. The simultaneous regression model for the MALa contribution to perceived recovery is reported in Table 4. The follow-up MALa score was the only contributor of perceived recovery (ß=0.80, P=.024) considered for cutoff score calculation. The regression model for the WMFT is reported in Table 5. The follow-up WMFT was the only predictor of perceived recovery (ß=–0.37, P=.030) considered for cutoff score calculation. Excessive collinearity did not appear to be a concern with the regression models because the VIF did not exceed 10.0 for any individual predictor variable.⁴¹

View larger version (16K): [in this window] [in a new window]   Figure. Receiver operating characteristic curves for prediction of perceived upper-extremity recovery rating with follow-up Motor Activity Log amount scale (MALa) scores (graph A) and with follow-up Wolf Motor Function Test (WMFT) scores (graph B). Y-axis represents the true positive rate, and x-axis represents the false positive rate. Perceived upper-extremity recovery variable was dichotomized into 50% (50% or greater perception of recovery in more affected upper extremity) and <50% (less than 50% perception of recovery in more affected upper extremity) groups. Diagonal segments are produced by ties.

	Discussion

Top Abstract Introduction Method Results Discussion Conclusions References

Our results show that if participants scored less than 1.15 on the MALa or more than 34.0 seconds on the WMFT on their follow-up posttest, they were more likely to indicate less than 50% recovery from their stroke. In contrast, if they scored greater than 2.50 on the MALa and less than an average of 11 seconds on the WMFT tasks, they were more likely to have rated 50% or more UE recovery from their stroke. Thus, these data give us a potential indication of the relationship between participants' perceived recovery and outcome measures used for CIMT. While the original intent of this project was to determine a minimal clinically important difference (MCID) for outcome measures following CIMT, our data supported the use of raw scores rather than change scores for predicting perceived recovery. When both the change and follow-up scores were simultaneously entered into the regression model, the follow-up scores were statistically more appropriate. This is a preliminary indication that a threshold score, and not a change score, is an appropriate measurement of improvement when the external criterion is participants' perceived recovery of UE function.

This methodology has not been widely utilized in the stroke literature, so comparisons to other studies are limited. For example, van der Lee et al⁴⁸ have proposed an MCID for the MAL that was 10% of the total range of the scale (0.5 change in MAL). This MCID was based on clinical expertise and reports of similar outcome measures used in manual therapy interventions for the spine.⁴⁹ While this proposed MCID for the MAL may have been a good starting ground to demonstrate improvement, measurement properties may have been neglected, as our data suggest that a threshold value may be more appropriate. Furthermore, the MCID proposed by van der Lee et al was not based on an external criterion. More research is needed to determine the meanings of changes in CIMT outcome measures and whether threshold or change scores predict outcome.

Other authors⁵⁰ have indicated that a threshold score based on the outcome measure's scoring definitions may be more appropriate. Preliminary results from the Extremity Constraint-Induced Therapy Evaluation (ExCITE) trial⁵¹ suggest that a numerical change in MAL may indicate an increase in amount or function of the affected hand and arm, but this change may not result in substantial or clinical improvement if the individual still cannot use the hand functionally. A suggested threshold of a 3.0 on the MAL, indicating that individuals are able to use their impaired hand independently, may be an appropriate threshold to determine functional significance.⁵⁰ That said, while possibly being an appropriate parameter to determine success, this approach does not offer a statistically calculated threshold that is linked to an external criterion based on the patient's perception of overall recovery.

Measuring and interpreting "clinically important change" have some limitations. The magnitude of this score can be influenced by prior functional level. Individuals who have lower initial functional levels may need smaller changes in function to achieve a "clinically important change." Individuals with higher initial function may need a greater change to render it clinically important.^15,18 We attempted to control for initial function by including covariates in the regression models. The extent of change that is considered to be minimally important also may differ depending on whether the external criterion is determined by clinician, the caregiver, payer, or the patient.^15,17,18 Using the participants' perception of recovery was core to our study. Clinically meaningful progress can be defined by many respondents following an intervention as what is "worthwhile."⁴⁰ In our study, the participants were the judge of what was a worthwhile improvement, consistent with a patient-centered model.^24–26 In such a model, the perception of recovery from stroke is the criterion by which the other CIMT outcome measures are judged and the determination of what is a meaningful change ultimately lies with the participant.

The potential limitations of this preliminary study should be considered when interpreting these results. First, this study was performed with individuals who met strict inclusion and exclusion criteria. While more diverse than most CIMT studies, this sample is not representative of the entire stroke population. Second, individuals were not randomly selected from the community, but were respondents to inquiries for participants.

Third, the external criterion for this study was based strictly on participant perspective. Although we have stated the importance of using the patient's perspective to determine what is a meaningful change, this approach can potentially introduce variability that may confound the responses. For instance, the participants' perceptions could have been influenced by depression, medication, or other behavior changes that we could not account for in our regression models.

Fourth, the reliability of MAL scores has been questioned in recent reports,^30,31 and although we used a different version of the MAL, our approach could have affected the study. A shortened version of the MAL (MAL-14) has shown improved reliability and validity over the original measure,³⁰ but that scale was not available at the time of the present study. No matter what form of the MAL is used, the effect that readministering the MAL within 2 weeks of its first application could have resulted in patient bias due to familiarity. Although this possibility has not been systematically studied, repeat baseline MAL testing within 2 weeks has not resulted in improved scores.⁵²

	Conclusions

Top Abstract Introduction Method Results Discussion Conclusions References

 
This study supports evidence for follow-up scores for MALa and the WMFT being predictive of perception of UE recovery, not change scores. Cutoff scores were proposed, but more research is needed to verify the accuracy of these scores.

	Footnotes

 
Dr Fritz provided concept/idea/research design. Dr Fritz, Dr George, and Dr Wolf provided writing and data analysis. Dr Fritz and Dr Light provided data collection and project management. Dr Light provided fund procurement, subjects, facilities/equipment, institutional liaisons, and clerical support. Dr Wolf and Dr Light provided consultation (including review of manuscript before submission). The authors acknowledge all of the therapists, physicians, and trainers who participated in subject recruitment, evaluation, and training. A special thanks to Andrea L Behrman, PT, PhD, Sandra B Davis, PT, and Stephen Nadeau, MD, for their guidance and participation. The authors also thank Shannon N Clifford, PT, for her suggestions that guided the design of the manuscript.

This study was supported, in part, by the Office of Research and Development Rehabilitation R&D Service, Brain Rehabilitation Research Center, Department of Veterans Affairs, Gainesville, Fla, and Florida Biomedical Grant BM042 (Principal Investigator: Dr Light).

^* SPSS Inc, 233 S Wacker Dr, Chicago, IL 60606.

	References

Top Abstract Introduction Method Results Discussion Conclusions References

 

1. Morris DM, Crago J, DeLuca S, et al. Constraint-Induced (CI) Movement Therapy for motor recovery after stroke. Neurorehabilitation. 1997;9:29–43.[Abstract/Free Full Text]
2. Taub E, Uswatte G, Pidikiti R. Constraint-Induced Movement Therapy: a new family of techniques with broad application to physical rehabilitation—a clinical review. J Rehabil Res Dev. 1999;36:237–251.[Web of Science][Medline]
3. American Stroke Association Web site. Available at: www.strokeassociation.org. Accessed September 2005.
4. Stineman M, Maislin G, Fiedler R, Granger C. A prediction model for functional recovery in stroke. Stroke. 1997;28:550–556.[Abstract/Free Full Text]
5. Kwakkel G, Kollen B, Van Der Grond J, Prevo A. Probability of regaining dexterity in the flaccid upper limb: impact of severity of paresis and time since onset in acute stroke. Stroke. 2003;34:2181–2186.[Abstract/Free Full Text]
6. Taub E, Crago J, Uswatte G. Constraint-induced movement therapy: a new approach to treatment in physical rehabilitation. Rehabilitation Psychology. 1998;43:152–170.[CrossRef][Web of Science]
7. van der Lee JH, Wagenaar RC, Lankhorst GJ, et al. Forced use of the upper extremity in chronic stroke patients: results from a single-blind randomized clinical trial. Stroke. 1999;30:2369–2375.[Abstract/Free Full Text]
8. Wolf SL, Lecraw D, Barton L. Forced use in hemiplegic upper extremities to reserve the effect of learned nonuse among chronic stroke and head-injured patients. Exp Neurol. 1989;104:125–132.[CrossRef][Web of Science][Medline]
9. Kunkel A, Kopp B, Muller G, et al. Constraint-induced movement therapy for motor recovery in chronic stroke patients. Arch Phys Med Rehabil. 1999;80:624–628.[CrossRef][Web of Science][Medline]
10. Miltner W, Bauder H, Sommer M, et al. Effects of constraint-induced movement therapy on patients with chronic motor deficits after stroke: a replication. Stroke. 1999;30:586–592.[Medline]
11. Wolf SL, Blanton S, Baer H, et al. Repetitive task practice: a critical review of constraint-induced movement therapy in stroke. Neurology. 2002;8:325–338.[CrossRef]
12. Dromerick A, Edwards D, Hahn M. Does the application of constraint-induced movement therapy during acute rehabilitation reduce arm impairment after ischemic stroke? Stroke. 2000;31:2984–2988.[Abstract/Free Full Text]
13. Liepert J, Uhde I, Graf S, et al. Motor cortex plasticity during forced-use therapy in stroke patients: a preliminary study. J Neurol. 2001;248:315–321.[CrossRef][Web of Science][Medline]
14. Taub E, Morris DM. Constraint-induced movement therapy to enhance recovery after stroke. Curr Atheroscler Rep. 2001;3:279–286.[Medline]
15. Iyer LV, Haley SM, Watkins MP, Dumas HM. Establishing minimal clinically important differences for scores on the pediatric evaluation of disability inventory for inpatient rehabilitation. Phys Ther. 2003;83:888–898.[Abstract/Free Full Text]
16. Hays RD, Woolley JM. The concept of clinically meaningful difference in health-related quality-of-life research: how meaningful is it? Pharmacoeconomics. 2000;18:419–423.[CrossRef][Web of Science][Medline]
17. Osoba D, Rodrigues G, Myles J, et al. Interpreting the significance of changes in health-related quality-of-life scores. J Clin Oncol. 1998;16:139–144.[Abstract/Free Full Text]
18. Liang MH. Longitudinal construct validity: establishment of clinical meaning in patient evaluative instruments. Med Care. 2000;38(9 suppl):II84–II90.
19. Lee JS, Hobden E, Stiell IG, Wells GA. Clinically important change in the visual analog scale after adequate pain control. Acad Emerg Med. 2003;10:1128–1130.[CrossRef][Web of Science][Medline]
20. Brunner HI, Klein-Gitelman MS, Miller MJ, et al. Minimal clinically important differences of the childhood health assessment questionnaire. J Rheumatol. 2005;32:150–161.[Abstract/Free Full Text]
21. Fritz JM, George SZ. Identifying psychosocial variables in patients with acute work-related low back pain: the importance of fear-avoidance beliefs. Phys Ther. 2002;82:973–983.[Abstract/Free Full Text]
22. Fritz JM, Irrgang JJ. A comparison of a modified Oswestry Low Back Pain Disability Questionnaire and the Quebec Back Pain Disability Scale. Phys Ther. 2001;81:776–788.[Abstract/Free Full Text]
23. Farrar JT, Portenoy RK, Berlin JA, et al. Defining the clinically important difference in pain outcome measures. Pain. 2000;88:287–294.[CrossRef][Web of Science][Medline]
24. Guide to Physical Therapist Practice. 2nd ed. Phys Ther. 2001;81:9–746.[Web of Science][Medline]
25. Robinson ME, Brown JL, George SZ, et al. Multidimensional success criteria and expectations for treatment of chronic pain: the patient perspective. Pain Med. 2005;6:336–345.[CrossRef][Web of Science][Medline]
26. Farrar JT, Young JP Jr, LaMoreaux L, et al. Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale. Pain. 2001;94:149–158.[CrossRef][Web of Science][Medline]
27. Turner JA, Jensen MP, Warms CA, Cardenas DD. Blinding effectiveness and association of pretreatment expectations with pain improvement in a double-blind randomized controlled trial. Pain. 2002;99(1–2):91–99.
28. Morris DM, Uswatte G, Crago JE, et al. The reliability of the wolf motor function test for assessing upper extremity function after stroke. Arch Phys Med Rehabil. 2001;82:750–755.[CrossRef][Web of Science][Medline]
29. Wolf SL, Catlin PA, Ellis M, et al. Assessing Wolf Motor Function Test as outcome measure for research in patients after stroke. Stroke. 2001;32:1635–1639.[Abstract/Free Full Text]
30. Uswatte G, Taub E, Morris DM, et al. Reliability and validity of the upper-extremity Motor Activity Log-14 for measuring real-world arm use. Stroke. 2005;36:2493–2496.[Abstract/Free Full Text]
31. van der Lee JH, Beckerman H, Knol DL, et al. Clinimetric properties of the motor activity log for the assessment of arm use in hemiparetic patients. Stroke. 2004;35:1410–1414.[Abstract/Free Full Text]
32. Gimenez-Roldan S, Novillo M, Navarro E, et al. Mini-mental state examination: proposal of protocol to be used. Rev Neurol. 1997;25:576–583.[Web of Science][Medline]
33. Blanton S, Wolf SL. An application of upper-extremity constraint-induced movement therapy in a patient with subacute stroke. Phys Ther. 1999;79:847–853.[Abstract/Free Full Text]
34. Fritz SL, Light KE, Patterson TS, et al. Active finger extension predicts outcomes after constraint-induced movement therapy for individuals with hemiparesis after stroke. Stroke. 2005;36:1172–1177.[Abstract/Free Full Text]
35. Fritz SL, Light KE, Clifford SN, et al. Descriptive characteristics as potential predictors of outcomes following constraint-induced movement therapy for people after stroke Phys Ther. 2006;86:825–832.[Abstract/Free Full Text]
36. Fritz SL. Functional and Descriptive Predictors of Outcomes Following Constraint-Induced Movement Therapy for Individuals With Post-Stroke Hemiparesis [dissertation]. Gainesville, Fla: University of Florida; 2004.
37. O'Sullivan S, Schmitz T. Physical Rehabilitation: Assessment and Treatment. 4th ed. Philadelphia, Pa: FA Davis Co; 2001.
38. Sanford J, Moreland J, Swanson LR, et al. Reliability of the Fugl-Meyer assessment for testing motor performance in patients following stroke. Phys Ther. 1993;73:447–454.[Abstract/Free Full Text]
39. Duncan P, Wallace D, Lai S, et al. The Stroke Impact Scale version 2.0: evaluation of reliability, validity, and sensitivity to change. Stroke. 1999;30:2131–2140.[Abstract/Free Full Text]
40. Jaeschke R, Singer J, Guyatt GH. Measurement of health status: ascertaining the minimal clinically important difference. Control Clin Trials. 1989;10:407–415.[CrossRef][Web of Science][Medline]
41. Kleinbaum D, Kupper L, Muller K, Nizam A. Applied Regression Analysis and Other Multivariable Methods. 3rd ed. Pacific Grove, Calif: Brooks/Cole Publishing Co; 1998
42. Deyo RA, Centor RM. Assessing the responsiveness of functional scales to clinical change: an analogy to diagnostic test performance. J Chronic Dis. 1986;39:897–906.[CrossRef][Web of Science][Medline]
43. Deyo RA, Diehr P, Patrick DL. Reproducibility and responsiveness of health status measures: statistics and strategies for evaluation. Control Clin Trials. 1991;12(4 suppl):142S–158S.
44. Hanley JA, McNeil BJ. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology. 1983;148:839–843.[Abstract/Free Full Text]
45. Park SH, Goo JM, Jo CH. Receiver operating characteristic (ROC) curve: practical review for radiologists. Korean J Radiol. 2004;5:11–18.[Web of Science][Medline]
46. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.[Abstract/Free Full Text]
47. Sackett D, Straus S, Richardson W, et al. Evidence-Based Medicine: How to Practice and Teach EBM. 2nd ed. London, United Kingdom: Churchill Livingstone; 2001.
48. van der Lee JH, Beckerman H, Lankhorst GJ, Bouter LM. Constraint-induced movement therapy. Arch Phys Med Rehabil. 1999;80:1606–1607.[Web of Science][Medline]
49. Bronfort G. Efficacy of Manual Therapies of the Spine [PhD thesis]. Amsterdam, the Netherlands: Thesis Publishers Amsterdam; 1997.
50. Wolf SL, Winstein CJ, Miller JP, Clark PC. The ExCITE trial: formulation, implementation, and results. Presented at: Combined Sections Meeting of the American Physical Therapy Association; February 1–5, 2006; San Diego, Calif.
51. Wolf SL. Extremity Constraint-Induced Therapy Evaluation (ExCITE). Bethesda, Md: National Institutes of Health; 2000. NCMRR-funded grant (R01HD037606-01A1).
52. Liepert J, Bauder H, Wolfgang HR, et al. Treatment-induced cortical reorganization after stroke in humans. Stroke. 2000;31:1210–1216.[Abstract/Free Full Text]

CiteULike

Complore

Connotea

Del.icio.us

Digg

Reddit

Technorati

This article has been cited by other articles:

				S. L. Fritz, S. Blanton, G. Uswatte, E. Taub, and S. L. Wolf Minimal Detectable Change Scores for the Wolf Motor Function Test Neurorehabil Neural Repair, September 1, 2009; 23(7): 662 - 667. [Abstract] [PDF]

				K. Bogard, S. Wolf, Qin Zhang, P. Thompson, D. Morris, and D. Nichols-Larsen Can the Wolf Motor Function Test be Streamlined? Neurorehabil Neural Repair, June 1, 2009; 23(5): 422 - 428. [Abstract] [PDF]

				A. Hammer and B. Lindmark Is forced use of the paretic upper limb beneficial? A randomized pilot study during subacute post-stroke recovery Clinical Rehabilitation, May 1, 2009; 23(5): 424 - 433. [Abstract] [PDF]

				S.-W. Park, S. L. Wolf, S. Blanton, C. Winstein, and D. S. Nichols-Larsen The EXCITE Trial: Predicting a Clinically Meaningful Motor Activity Log Outcome Neurorehabil Neural Repair, September 1, 2008; 22(5): 486 - 493. [Abstract] [PDF]

				S. L Wolf On "Modified constraint-induced therapy..." Page et al. Phys Ther. 2008;88:333-340. Physical Therapy, May 1, 2008; 88(5): 680 - 684. [Full Text] [PDF]

				S. L. Wolf, C. J. Winstein, J. P. Miller, S. Blanton, P. C. Clark, and D. Nichols-Larsen Looking in the Rear View Mirror When Conversing With Back Seat Drivers: The EXCITE Trial Revisited Neurorehabil Neural Repair, October 1, 2007; 21(5): 379 - 387. [Abstract] [PDF]

This Article Abstract Full Text (PDF) The Bottom Line All Versions of this Article: ptj.20060101v1 87/2/170    most recent Submit a response Alert me when this article is cited Alert me when Rapid Responses are posted Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Fritz, S. L Articles by Light, K. E Search for Related Content PubMed PubMed Citation Articles by Fritz, S. L Articles by Light, K. E Related Collections Adaptive/Assistive Devices Therapeutic Exercise Stroke (Neurology) Tests and Measurements Stroke (Geriatrics) Social Bookmarking                      What's this?