|
|
||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Research Reports |
GF Marchetti, PT, PhD, is Assistant Professor, Department of Physical Therapy, Duquesne University, Pittsburgh, Pa, and Assistant Professor, Department of Otolaryngology, University of Pittsburgh, Pittsburgh, Pa
SL Whitney, PT, PhD, NCS, ATC, is Associate Professor, Departments of Physical Therapy and Otolaryngology, University of Pittsburgh, 6035 Forbes Tower, Pittsburgh, PA 15260 (USA), and Program Director, Physical Therapy Department, Centers for Rehab Services, University of Pittsburgh Medical Center, Pittsburgh, Pa
Address all correspondence to Dr Whitney at: whitney{at}pitt.edu
Submitted December 29, 2005;
Accepted July 24, 2006
| Abstract |
|---|
Key Words: Gait Measurement Validity Vestibular system
| Introduction |
|---|
|
|
|---|
The DGI was developed for use in community-living older people and also has been used for people with balance and vestibular disorders.2–14 The DGI is an 8-item tool with which the examiner rates an individual's gait performance on an ordinal scale that ranges from 0 to 3.1 Higher scores indicate better performance, with a maximal score of 24. Items on the DGI require people to modify their gait while ambulating. Interrater reliability for people with peripheral vestibular disorders has been reported to have a composite kappa of .64 and a Spearman rho of .95 for the 8-item test based on the scores of 2 raters.12 The concurrent validity of the DGI and the Berg Balance Scale for people with central and peripheral vestibular disorders has been established,8 and the DGI also correlates well with the Activities-specific Balance Confidence Scale,4 which is a self-report scale of balance confidence.15
Scores on the DGI of less than 20 have been related to reported falls in community-living older people16,17 and in people with central and peripheral vestibular dysfunction.3,5,10 The DGI has been used widely as an outcome measure and has demonstrated change over the course of a vestibular rehabilitation program.2,3,6,7,14 It takes approximately 10 minutes or less to complete and score the DGI. If the tool could provide comparable data with fewer items, a shorter version would make the examiner more efficient.
The purpose of this study was to determine whether the DGI could be shortened from its original form. We hypothesized that the use of fewer items on the DGI could provide results comparable to those of the 8-item DGI. Thus, a Rasch analysis was performed to determine whether a shorter version of the DGI could provide valid results without a loss of integrity of the tool. The items that were chosen for the shorter version of the DGI were selected on the basis of content, subject performance, clinical feasibility (time and equipment), and fit with the single construct of dynamic gait performance.
| Method |
|---|
|
|
|---|
Procedure
The scoring of each item of the DGI ranges from 0 to 3, with 0 indicating that the individual is unable to perform the walking skill and 3 indicating that the individual can perform the skill normally. Each of the 8 DGI walking skills has written descriptors to assist physical therapists in scoring. All testers had to be within 1 DGI point of the second author with 5 consecutive test subjects to collect DGI data in the clinical setting.
Intertester agreement had been previously established for experienced physical therapists with the 8-item DGI for subjects (test and control) in a tertiary-care clinical setting over 2 separate testing sessions. Agreement between raters was shown to be good to excellent across all items.18 Mean kappa statistics for 6 paired clinician ratings across the 8 items for 39 subjects ranged from .54 (walking with pivot turn) to .80 (level gait).
All of the data from people without balance and vestibular dysfunction were collected prospectively by the second author (a physical therapist) for several ongoing and previously completed studies. All control subjects had a normal neurologic examination by a board-certified neurologist, normal age-adjusted hearing, normal vestibular test results (rotational chair, caloric, positional, and oculomotor), normal corrected vision, and intact distal sensation (monofilament testing). All control subjects were recruited through advertisements and were screened by telephone for significant medical comorbidities. The score on each of the 8 DGI items was recorded, as was the DGI total score. Reports of falls in the previous 6 months were recorded for the test subjects, but those data were not collected for the control subjects. All test subjects were asked in a systematic way during the initial examination about their falls, and the information was recorded in the chart.
Data Analysis
The selection of items to be retained for the shorter version of the DGI was performed with Rasch analysis for determination of the difficulty of items from the original 8-item DGI and interitem scaling for 123 people with vestibular disease.19–23 Rasch analysis is a statistical technique that develops a continuous interval measurement scale from an ordinal outcome score by use of a logistic regression model.19 A measurement scale was constructed from the DGI on the basis of the assumption that an individual's performance on each DGI item is a function of that individual's ability and of item difficulty. The mean total score for each subject as well as for each item on the DGI was determined from the interval scale.
Conversion to an interval scale allowed evaluation of the spread and for detection of any redundancy among the 8 items of the original DGI tool. Items that appeared to have similar difficulty and items that demonstrated a poor fit with an individual's performance on the other items were identified and eliminated. The reduced-item DGI scale then was reanalyzed to determine the difficulty of the items, the inter-item spread on the newly proposed scale, and the distribution of subject performance on the new scale. The objective of the Rasch analysis was to retain the smallest number of items that still adequately reflected an individual's ability to perform dynamic gait activities.19 Subjects clinical performance ratings that were unusual on the basis of the model predictions (outfit statistic) or item ratings that were unexpected on the basis of subject ability (infit statistic) were used to remove items and improve the psychometric properties of the new scale.19,21–23
Principal components factor analysis was used to describe the degree to which the original 8 DGI items represented the underlying construct of dynamic gait and the amount of variance in subject (test, control, and combined) performance that was explained by a single construct.19 A subsequent factor analysis was performed after removal of the items identified previously by Rasch analysis. The factor structure and amount of variance in subject performance explained by the items in the reduced scale were estimated.
The frequencies of categorical performance ratings on the items retained for the revised DGI were described with frequency counts and percentages for each item. The internal consistency, or the relationship between individual test items, was determined for the 8-item DGI and the reduced-item DGI with both test and control subjects. The alpha coefficient, the correlation between item and total scores, and the average inter-item correlation were described and compared between the 8-item and reduced-item versions of the DGI.19
It is important to demonstrate that scores on the reduced-item DGI reflect performance changes attributable to the presence of vestibular or balance dysfunction. The total scores for the subjects with documented vestibular or balance dysfunction on the reduced-item test were compared with those for the control subjects. Statistical comparison between the 2 groups was made by use of the nonparametric Mann-Whitney U test with a type I error rate of less than .05. Because of the significant age difference between the test and control subject groups, this analysis also was performed with subjects stratified by age at younger than 65 years and 65 years and older.
The discriminative abilities of the gait measures, recorded with the reduced-item DGI, to detect performance changes attributable to vestibular or balance dysfunction were compared with those of the 8-item DGI by use of receiver operating characteristic curve (ROC) analysis.24 For both the 8-item test and the reduced-item test total scores, the sensitivity and specificity for identifying test and control subjects were determined for each possible total score. The area under the curve (AUC) that was generated by plotting sensitivity against the rate of false-positive results (1 – sensitivity) for detecting test and control subjects was tested against a null-hypothesis AUC of .50, indicating no discriminative value.
Curves for both the 8-item test and the reduced-item test total scores were analyzed by use of a type I error rate of less than .05. The total scores on both the 8-item DGI and the reduced-item DGI that maximized the sensitivity and specificity for discriminating test subjects from control subjects were identified. Because of the significant mean age difference between the test and control subjects, with test subjects generally being older, the ROC curve analysis was performed for subjects stratified by age at younger than 65 years and 65 years and older.
It is important that scores on the reduced-item DGI reflect performance variations attributable to vestibular or balance disease severity. Total scores on the reduced-item test were compared between 34 test subjects who reported at least 1 fall in the 6 months prior to examination and 89 test subjects who had no self-reported falls. Statistical comparison between the 2 groups was made by use of the nonparametric Mann-Whitney U test with a type I error rate of less than .05.
The discriminative abilities of the reduced-item DGI to detect performance changes attributable to disease severity as reflected by a history of falling were compared with those of the 8-item DGI by use of ROC analysis.24 For both the 8-item test and the reduced-item test total scores, the sensitivity and specificity for discriminating test subjects who reported falling from those not reporting falling were determined for each possible total score. The AUC that was generated by plotting the sensitivity against the rate of false-positive results (1 – sensitivity) for discriminating subjects who reported falling from those not reporting falling was tested against a null-hypothesis AUC of .50, indicating no discriminative value. The curves for both the 8-item test and the reduced-item test total scores were analyzed by use of a type I error rate of less than .05. The total scores on both the 8-item DGI and the reduced-item DGI that maximized the sensitivity and specificity for discriminating test subjects who reported falling from test subjects who had no self-reported falls in the previous 6 months were identified.
The WINSTEPS Rasch Measurement Software, version 3.57,* was used for Rasch and principal components analyses. The Statistical Package for Social Sciences, version 13.0,
was used to determine the internal consistency and abilities to discriminate between test and control subjects and between test subjects who reported having fallen and those who had no reports of recent falls (in the previous 6 months).
| Results |
|---|
|
|
|---|
|
|
|
The Rasch model fit statistics (infit and outfit) are presented as standardized scores (ZSTD). Infit ZSTD describes the difference in the overall data between the model prediction and the observed subject performance on the item.19 Outfit ZSTD describes the average divergence of the item difficulty and the subject performance from what would be predicted by the Rasch model for each item.19 Infit ZSTD and outfit ZSTD have expected values of 0. The signs of ZSTD indicate whether more (positive) or less (negative) variation than expected from the model is demonstrated by the response data.
Infit and outfit ZSTD scores of greater than +2 or less than –2 are interpreted as having less compatibility with the model than expected (P<.05).19 The 4 retained items demonstrated satisfactory fit with test subject performance ratings. The point biserial correlation coefficients shown in Tables 1 and 2 indicate the correlations (–1 to +1) between each item score and the cumulative score obtained from the remaining items across the test subject sample. The point biserial correlation coefficients indicate a satisfactory fit within the domain of dynamic gait performance.19 The overall model fit statistics show a mean infit ZSTD of –0.1 and a mean outfit ZSTD of –0.2 across the 4 DGI items, indicating a highly satisfactory fit with the construct of dynamic gait. The subject separation reliability for the 4-item DGI was shown to be high (.79). The item difficulty separation reliability was shown to be excellent (.99).
Principal components factor analysis of the 8-item DGI demonstrated that 65.5% of the total variance for the combined sample of test and control subjects was explained by a single construct. For the subsample of 123 test subjects, 59.4% of the variance in the 8-item DGI was explained by a single construct. Table 3 shows the proportional factor loading for each item on the single construct.
|
Figure 2 shows the percentages of scores across the grading criteria (0–3) on the 4-item DGI for the test and control subjects. Horizontal and vertical head turns were difficult for both test and control subjects. Control subjects demonstrated minimal impairment in level gait and no impairment in gait with speed changes.
|
The mean 4-item DGI total scores for test and control subjects in the entire subject sample and for subjects stratified by age at younger than and older than 65 years are shown in Figure 3. Control subjects demonstrated significantly higher 4-item DGI total scores than test subjects in all groups (Mann-Whitney U test, P<.01).
|
|
|
Figure 6 displays the ROC curves that describe the abilities of the 8-item DGI and 4-item DGI total scores to identify test subjects with a history of falls and test subjects who had not fallen in the 6 months prior to examination. The AUCs for both tests were significantly different from the null AUC of .50 (P<.01). The 4-item test appeared to provide identification of test subjects with a history of falls similar to that of the 8-item test. The AUC for both the 8-item DGI total score and the 4-item DGI total score was .67.
|
| Discussion |
|---|
|
|
|---|
Head turns in the horizontal plane were more difficult than head movements in the vertical plane during gait for people with balance and vestibular disorders in the present study and in another reported study.10 It was unexpected that walking straight would be slightly more difficult than walking with a change in speed, although the items had similar levels of difficulty (35.4 versus 31.5; Tab. 2). Less than optimal performance while walking on level surfaces and walking at different speeds appeared to best identify people with the greatest impairments. Therefore, both items were retained because it was believed that including both items (walking on level surfaces and walking with changes in speed) would improve the precision of measurement at this level of function (Fig. 2).
Mild instability of gait while moving the head (up or down and right or left) is a relatively common condition in control subjects, although greater difficulty with walking with head movements was seen in older people. Eleven percent of the younger control subjects and 41% of the control subjects 65 years and older scored 2 (mild impairment) or less on horizontal head turns. Similarly, 3% of younger control subjects and 23% of control subjects 65 years and older scored 2 (mild impairment) or less on vertical head movements during walking.
The discriminative validity of inferences from the 4-item DGI is equivalent to that of the 8-item DGI. The 4-item tool can allow differentiation between control subjects and subjects with balance and vestibular disease. In addition, the 4-item DGI allows differentiation of subjects with a self-reported history of falling from those without a self-reported history of falling. The 8-item DGI total score is more sensitive at its optimal cutoff value for identifying people who have reported a fall, yet the 4-item DGI total score is more specific at its optimal cutoff value. Without prospective data, it is impossible to accurately determine the predictive validity of the 4-item DGI or the 8-item DGI for a future fall event. With regard to the use of the 4-item DGI as a screening tool for falls, the higher specificity of the 4-item DGI suggests that a closer evaluation of fall risk factors is indicated if an individual has a score of less than 10 of 12.
Future plans for the 4-item DGI include comparing the 4-item DGI score to quantitative gait analysis as a means to validate the ordinal scoring of the DGI. In addition, the responsiveness of the 4-item DGI to changes in subject status over the course of vestibular rehabilitation will be investigated. In order to demonstrate the stability of this model across groups of subjects, a follow-up study that tests the model with an independent group of subjects is necessary to validate the findings.
| Conclusion |
|---|
|
|
|---|
| Footnotes |
|---|
This study was approved by the institutional review board of the University of Pittsburgh.
This project was supported, in part, by National Institutes of Health grants DC 05384 (to Dr Whitney), AG10009, and R01 AG14116.
A portion of these data were presented at the Combined Sections Meeting of the American Physical Therapy Association; February 3, 2006; San Diego, Calif.
* Winsteps, PO Box 811322, Chicago IL 60681-1322. ![]()
SPSS Inc, 233 S Wacker Dr, Chicago, IL 60606. ![]()
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
S. M. O'Connor and A. D. Kuo Direction-Dependent Control of Balance During Walking and Standing J Neurophysiol, September 1, 2009; 102(3): 1411 - 1419. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. F Marchetti, S. L Whitney, P. J Blatt, L. O Morris, and J. M Vance Temporal and Spatial Characteristics of Gait During Performance of the Dynamic Gait Index in People With and People Without Balance or Vestibular Disorders Physical Therapy, May 1, 2008; 88(5): 640 - 651. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |