|
|
||||||||
Research Reports |
CG Maher, PT, PhD, is Associate Professor, School of Physiotherapy, Faculty of Health Sciences, The University of Sydney, PO Box 170, Lidcombe, New South Wales 1825, Australia (C.Maher{at}fhs.usyd.edu.au). Address all correspondence to Dr Maher
C Sherrington, PT, PhD, is Research Officer, Prince of Wales Medical Research Institute, University of New South Wales, Sydney, New South Wales, Australia
RD Herbert, PT, PhD, is Senior Lecturer, School of Physiotherapy, The University of Sydney
AM Moseley, PT, PhD, is Lecturer, Rehabilitation Studies Unit, Department of Medicine, The University of Sydney
M Elkins, PT, M-HSc, is Research Physiotherapist, Department of Respiratory Medicine, Royal Prince Alfred Hospital, Camperdown, New South Wales, Australia
Background and Purpose. Assessment of the quality of randomized controlled trials (RCTs) is common practice in systematic reviews. However, the reliability of data obtained with most quality assessment scales has not been established. This report describes 2 studies designed to investigate the reliability of data obtained with the Physiotherapy Evidence Database (PEDro) scale developed to rate the quality of RCTs evaluating physical therapist interventions. Method. In the first study, 11 raters independently rated 25 RCTs randomly selected from the PEDro database. In the second study, 2 raters rated 120 RCTs randomly selected from the PEDro database, and disagreements were resolved by a third rater; this generated a set of individual rater and consensus ratings. The process was repeated by independent raters to create a second set of individual and consensus ratings. Reliability of ratings of PEDro scale items was calculated using multirater kappas, and reliability of the total (summed) score was calculated using intraclass correlation coefficients (ICC [1,1]). Results. The kappa value for each of the 11 items ranged from .36 to .80 for individual assessors and from .50 to .79 for consensus ratings generated by groups of 2 or 3 raters. The ICC for the total score was .56 (95% confidence interval=.47.65) for ratings by individuals, and the ICC for consensus ratings was .68 (95% confidence interval=.57.76). Discussion and Conclusion. The reliability of ratings of PEDro scale items varied from "fair" to "substantial," and the reliability of the total PEDro score was "fair" to "good."
Key Words: Evidence-based medicine Meta-analysis Physical therapy Randomized controlled trials
![]()
CiteULike
Complore
Connotea
Del.icio.us
Digg
Reddit
Technorati What's this?
This article has been cited by other articles:
![]() |
S. K. Subramanian, C. L. Massie, M. P. Malcolm, and M. F. Levin Does Provision of Extrinsic Feedback Result in Improved Motor Learning in the Upper Limb Poststroke? A Systematic Review of the Evidence Neurorehabil Neural Repair, February 1, 2010; 24(2): 113 - 124. [Abstract] [PDF] |
||||
![]() |
A. T. M. van de Water and C. M. Speksnijder Efficacy of Taping for the Treatment of Plantar Fasciosis: A Systematic Review of Controlled Trials J Am Podiatr Med Assoc, January 1, 2010; 100(1): 41 - 51. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. D. Alexander, D. R.D. Gilman, D. R. Brown, J. L. Brown, and P. E. Houghton Exposure to Low Amounts of Ultrasound Energy Does Not Improve Soft Tissue Shoulder Pathology: A Systematic Review Physical Therapy, January 1, 2010; 90(1): 14 - 25. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. D. O'Shea, N. F. Taylor, and J. D. Paratz Progressive Resistance Exercise Improves Muscle Strength and May Improve Elements of Performance of Daily Activities for People With COPD: A Systematic Review Chest, November 1, 2009; 136(5): 1269 - 1283. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. B. Landorf Letters to the Editor: Extracorporeal Shockwave Therapy for Interdigital Neuroma: A Randomized, Placebo-Controlled, Double-Blind Trial J Am Podiatr Med Assoc, September 1, 2009; 99(5): 472 - 473. [Full Text] [PDF] |
||||
![]() |
C. Maher PRISMA: Helping to Deliver Information That Physical Therapists Need Physical Therapy, September 1, 2009; 89(9): 870 - 872. [Full Text] [PDF] |
||||
![]() |
Y. Borisova and R. W Bohannon Positioning to prevent or reduce shoulder range of motion impairments after stroke: a meta-analysis Clinical Rehabilitation, August 1, 2009; 23(8): 681 - 686. [Abstract] [PDF] |
||||
![]() |
M Roig, K O'Brien, G Kirk, R Murray, P McKinnon, B Shadgan, and W D Reid The effects of eccentric versus concentric resistance training on muscle strength and mass in healthy adults: a systematic review with meta-analysis Br. J. Sports Med., August 1, 2009; 43(8): 556 - 568. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. O. P. Costa, C. G. Maher, J. Latimer, and R. J.E.M. Smeets Reproducibility of Rehabilitative Ultrasound Imaging for the Measurement of Abdominal Muscle Activity: A Systematic Review Physical Therapy, August 1, 2009; 89(8): 756 - 769. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. M. Coffman, M. D. Cabana, and E. H. Yelin Do School-Based Asthma Education Programs Improve Self-Management and Health Outcomes? Pediatrics, August 1, 2009; 124(2): 729 - 742. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Wevers, I. van de Port, M. Vermue, G. Mead, and G. Kwakkel Effects of Task-Oriented Circuit Class Training on Walking Competency After Stroke: A Systematic Review Stroke, July 1, 2009; 40(7): 2450 - 2459. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Sakzewski, J. Ziviani, and R. Boyd Systematic Review and Meta-analysis of Therapeutic Management of Upper-Limb Dysfunction in Children With Congenital Hemiplegia Pediatrics, June 1, 2009; 123(6): e1111 - e1122. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Langer, E. Hendriks, C. Burtin, V. Probst, C. van der Schans, W. Paterson, M. Verhoef-de Wijk, R. Straver, M. Klaassen, T. Troosters, et al. A clinical practice guideline for physiotherapists treating patients with chronic obstructive pulmonary disease based on a systematic review of available evidence Clinical Rehabilitation, May 1, 2009; 23(5): 445 - 462. [Abstract] [PDF] |
||||
![]() |
L. A. C. Machado, S. J. Kamper, R. D. Herbert, C. G. Maher, and J. H. McAuley Analgesic effects of treatments for non-specific low back pain: a meta-analysis of placebo-controlled randomized trials Rheumatology, May 1, 2009; 48(5): 520 - 527. [Abstract] [Full Text] [PDF] |
||||
![]() |
M Asano, D. Dawes, A Arafah, C Moriello, and N. Mayo What does a structured review of the effectiveness of exercise interventions for persons with multiple sclerosis tell us about the challenges of designing trials? Multiple Sclerosis, April 1, 2009; 15(4): 412 - 421. [Abstract] [PDF] |
||||
![]() |
B. J. Kollen, S. Lennon, B. Lyons, L. Wheatley-Smith, M. Scheper, J. H. Buurke, J. Halfens, A. C.H. Geurts, and G. Kwakkel The Effectiveness of the Bobath Concept in Stroke Rehabilitation: What is the Evidence? Stroke, April 1, 2009; 40(4): e89 - e97. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. A. Padua and L. J. DiStefano Sagittal Plane Knee Biomechanics and Vertical Ground Reaction Forces Are Modified Following ACL Injury Prevention Programs: A Systematic Review Sports Health: A Multidisciplinary Approach, March 1, 2009; 1(2): 165 - 173. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Waller, J. Lambeck, and D. Daly Therapeutic aquatic exercise in the treatment of low back pain: a systematic review Clinical Rehabilitation, January 1, 2009; 23(1): 3 - 14. [Abstract] [PDF] |
||||
![]() |
L. G Macedo, C. G Maher, J. Latimer, and J. H McAuley Motor Control Exercise for Persistent, Nonspecific Low Back Pain: A Systematic Review Physical Therapy, January 1, 2009; 89(1): 9 - 25. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. G Maher, A. M Moseley, C. Sherrington, M. R Elkins, and R. D Herbert A Description of the Trials, Reviews, and Practice Guidelines Indexed in the PEDro Database Physical Therapy, September 1, 2008; 88(9): 1068 - 1077. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Meilink, B. Hemmen, H. Seelen, and G. Kwakkel Impact of EMG-triggered neuromuscular stimulation of the wrist and finger extensors of the paretic hand after stroke: a systematic review of the literature Clinical Rehabilitation, April 1, 2008; 22(4): 291 - 305. [Abstract] [PDF] |
||||
![]() |
R. L. Zemek, S. K. Bhogal, and F. M. Ducharme Systematic Review of Randomized Controlled Trials Examining Written Action Plans in Children: What Is the Plan? Arch Pediatr Adolesc Med, February 1, 2008; 162(2): 157 - 163. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. A. Olivo, L. G. Macedo, I. C. Gadotti, J. Fuentes, T. Stanton, and D. J Magee Scales to Assess the Quality of Randomized Controlled Trials: A Systematic Review Physical Therapy, February 1, 2008; 88(2): 156 - 175. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. D. Carnaby-Mann and M. A. Crary Examining the Evidence on Neuromuscular Electrical Stimulation for Swallowing: A Meta-analysis Arch Otolaryngol Head Neck Surg, June 1, 2007; 133(6): 564 - 571. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Markovic and R. U Newton Does plyometric training improve vertical jump height? A meta-analytical review * Commentary Br. J. Sports Med., June 1, 2007; 41(6): 349 - 355. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. L Woodley, R. J Newsham-West, G D. Baxter, M Kjaer, and M S Koehle Chronic tendinopathy: effectiveness of eccentric exercise * COMMENTARY 1 * COMMENTARY 2 Br. J. Sports Med., April 1, 2007; 41(4): 188 - 198. [Full Text] [PDF] |
||||
![]() |
N. A de Morton, J. L Keating, and K. Jeffs The effect of exercise on outcomes for older acute medical inpatients compared with control or alternative treatments: a systematic review of randomized controlled trials Clinical Rehabilitation, January 1, 2007; 21(1): 3 - 16. [Abstract] [PDF] |
||||
![]() |
J A Radford, J Burns, R Buchbinder, K B Landorf, C Cook, and K Rome Does stretching increase ankle dorsiflexion range of motion? A systematic review * COMMENTARY Br. J. Sports Med., October 1, 2006; 40(10): 870 - 875. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. M. Levack, K. Taylor, R. J Siegert, S. G Dean, K. M McPherson, and M. Weatherall Is goal planning in rehabilitation effective? A systematic review Clinical Rehabilitation, September 1, 2006; 20(9): 739 - 755. [Abstract] [PDF] |
||||
![]() |
N. C Foley, S. K Bhogal, R. W Teasell, Y. Bureau, and M. R Speechley Estimates of Quality and Reliability With the Physiotherapy Evidence-Based Database Scale to Assess the Methodology of Randomized Controlled Trials of Pharmacological and Nonpharmacological Interventions Physical Therapy, June 1, 2006; 86(6): 817 - 824. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Y. Pang, J. J Eng, A. S Dawson, and S. Gylfadottir The use of aerobic exercise training in improving aerobic capacity in individuals with stroke: a meta-analysis Clinical Rehabilitation, February 1, 2006; 20(2): 97 - 111. [Abstract] [PDF] |
||||
![]() |
L Bisset, A Paungmali, B Vicenzino, E Beller, and R D Herbert A systematic review and meta-analysis of clinical trials on physical interventions for lateral epicondylalgia * Commentary Br. J. Sports Med., July 1, 2005; 39(7): 411 - 422. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. G Maher, C. Sherrington, M. Elkins, R. D Herbert, and A. M Moseley Challenges for Evidence-Based Physical Therapy: Accessing and Interpreting High-Quality Evidence on Therapy Physical Therapy, July 1, 2004; 84(7): 644 - 654. [Abstract] [Full Text] [PDF] |
||||
![]() |
N A Lannin and R D Herbert Is hand splinting effective for adults following stroke? A systematic review and methodological critique of published research Clinical Rehabilitation, August 1, 2003; 17(8): 807 - 816. [Abstract] [PDF] |
||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |