|
|
||||||||
Research Reports |
BH Connolly, PT, EdD, is Professor and Chair, Department of Physical Therapy, College of Allied Health Sciences, University of Tennessee Health Science Center, 822 Beale St, Memphis, TN 38363 (USA) (bconnolly{at}utmem.edu).
NS Lupinnaci, PT, MS, is currently in private practice. She was a faculty member at the University of Tennessee Health Science Center when this research was completed
AJ Bush, PhD, is Professor, Division of Biostatistics and Epidemiology, College of Medicine, University of Tennessee Health Science Center. Dr Bush also holds a joint appointment as Associate Professor in the Department of Physical Therapy
Address all correspondence to Dr Connolly
Submitted August 16, 1999;
Accepted January 8, 2001
| Abstract |
|---|
Key Words: Attitudes Educational outcomes Research
| Introduction |
|---|
|
|
|---|
Today the health care literature is filled with arguments about the importance of outcomes research and evidence-based practice.1116 Therefore, we believe the examination of currently used and new treatment procedures should be of importance to new graduates, to the practicing clinician, to the educator, and to the full-time researcher. In addition, the goals of APTA include: "Stimulate research to further the science of physical therapy, to influence current and emerging health care trends, and to advance the profession."17 This goal, in our opinion, should drive the profession to create an environment for evidence-based practice in order to best serve the needs of patients and clients. We believe that the need for research regarding the effectiveness of physical therapy interventions is critical because of changes in the health care system, including increased enrollment in managed health care organizations, capitation of services, decreased third-party reimbursement, and expanded interest in health promotion and disease prevention. Due to increasing health care costs and competition for available health care dollars, health services that are reimbursed, according to many experts, will need to be justified based on the contribution they make to overall patient outcome, as well as to their cost-effectiveness.15 Members of the physical therapy profession, we believe, must assume the responsibility to perform the research necessary to determine whether physical therapy interventions work and to base clinical practice on procedures that have been demonstrated to be the most effective interventions.14,15
The physical therapy profession, through accreditation standards for research9 and the APTA normative model of professional education,10 has addressed the importance of educating physical therapist students in the basic principles of research. The expectations that students can "[e]valuate published studies related to physical therapy practice, research, and education; secure and critically evaluate information related to new and established techniques and technology, legislation, policy, and environments related to patient or client care; and participate in scholarly activities to contribute to the body of physical therapy knowledge" are clearly outlined in the Evaluative Criteria for Accreditation of Education Programs for the Preparation of Physical Therapists.9(pp2829) More in-depth explanations of the professional expectations for the physical therapy graduate in the area of critical inquiry and clinical decision making are presented in A Normative Model of Physical Therapist Professional Education,10 a document that was jointly developed by academicians and clinicians through a series of consensus conferences. As stated in the normative models, examples of outcomes for properly educating physical therapists include: use of effectiveness studies to establish patient or client care protocols, application of the principles of clinical decision making in the delivery of care, assessment of published studies for the adequacy of adherence to research protocols, valuing research and clinical inquiry, and participation in collecting data using standardized assessment and measurement tools.10
A review of the literature indicates concern among educators and clinicians about the most effective methods of producing graduates who possess knowledge about research and an appreciation of the importance of basing treatment methods on research findings.14,16,1823 A variety of opinions have been expressed on the manner in which these goals are best accomplished in a professional (ie, entry-level) curriculum. Opinions range from having students critique published research, to writing research proposals but not actually carrying out projects, to adopting and assisting with a faculty research project, to actually completing an independent research project.2,14,1922 Rothstein23 proposed that education programs should discontinue the practice of requiring research projects of professional students. He based this proposal on his assumptions that "within the confines of professional education, students cannot possibly understand the nuances of questions, assimilate the background literature, develop theoretical bases, and comprehend measurement and design issues."23(p332) Rothstein further proposed that the projects of professional students might be credible, scientific case studies.
Numerous real or perceived barriers to participating in physical therapy research seem to exist among physical therapists once they enter clinical practice.14,16,1821,24 Ballin et al18 studied a sample of California therapists and assessed the importance of research to them, as well as factors that impeded their involvement in research and the extent to which they used published research. Although they reported that 100% of the respondents agreed about the importance of research, among the barriers to participation in research were the inability to give up revenue-producing time, lack of administrative financial support, and unfamiliarity with research methods. The APTA 1996 Practice Profile Report25 revealed that only about 58% of graduates from both baccalaureate and postbaccalaureate programs indicated that they had sufficient knowledge of research methods and design to critically read and evaluate research reports published in scholarly journals. Likewise, a study of critical appraisal of research literature revealed that one half of the inexperienced physical therapy researchers indicated low levels of self-reported comfort with research.26
The lack of knowledge or familiarity with research methods is one problem that we believe can and must be addressed in physical therapist education programs. In this environment, students can become knowledgeable in the basic methods, terminology, and statistics of research so that they will become competent, critical consumers of the scientific literature.24,14,21,22 A mastery of this knowledge, in our view, is a critical link in the process of incorporating the results of sound, scientific studies into clinical practice. Equally important for students is the development of positive attitudes toward the importance of research to the growth of the body of knowledge in physical therapy, realization of the need to incorporate research findings in practice, and acceptance of personal responsibility to prompt, encourage, or participate in research.4,14,19,23,24 The importance of research education also has been recognized by other health care professions as a crucial link to validating clinical practice and to closing the gap between published research in professional journals and actual practice in the clinical setting.20,27,28 We believe that the resources and faculty with research experience are increasingly more available to students in physical therapy. The number of physical therapists with doctoral degrees as the highest degree has increased over time (3.3% in APTA's 1996 Practice Profile Report25). However, having a doctoral degree does not ensure that the physical therapist either in academia or in the clinical setting has adequate resources for research.
A longitudinal study of physical therapist students' attitudes, perceptions, and feelings of competence regarding research, of their ability to critically review the scientific literature, of the importance of reading the literature, and of the value of research to the profession has not been done. Because uncertainty about research knowledge and skills has been demonstrated in cross-sectional studies among students and therapists,25,26 we chose to do a longitudinal study to examine how values and perceptions regarding research change over time and to determine the level of support present in the clinical setting for the knowledge and values that we believe are developed by students during their education programs. Therefore, the purpose of our study was to examine: (1) the perception of knowledge and behaviors of students with respect to research, (2) the perception of the source of authority for clinical decision making, and (3) the perception of clinical norms related to research of therapists from their student days through the first year of practice.
Our hypothesis was that students' attitudes and perceptions of knowledge about research, the importance of research to the profession, the importance of regularly reviewing the literature, and basing clinical decisions on scientifically sound methods would undergo a change in a positive direction as they were exposed to didactic and clinical experiences involving research.
| Method |
|---|
|
|
|---|
Graduates from the program typically practice upon graduation throughout the state of Tennessee and in the neighboring states of Alabama, Arkansas, Mississippi, Kentucky, and North Carolina. Clinical education experiences during the education program occur in sites throughout the Southeast, Midwest, and Atlantic Coast states. Therefore, the students' observations of utilization of or participation in research in clinical settings does not occur predominantly in practices close to the education program location. No differences were found for age between those students who completed all 4 questionnaires (mean age=24.5 years, SD=3.50) and the total sample (mean age=24.5 years, SD=3.38). Likewise, no difference was found for gender between those students who completed all 4 questionnaires and the total sample. Therefore, the students who completed all 4 questionnaires are representative of the total sample. All students signed informed consent statements prior to participation.
Instrumentation
We designed a questionnaire containing 10 items. We did this with input from faculty in the physical therapy program as well as with assistance from biostatisticians from the University of Tennessee Health Science Center. The items were designed to assess the students' self-reports of knowledge and behaviors related to research. This included their self-reports of their comfort level and confidence in reading and applying research findings, their personal habits regarding reading the professional literature, and their beliefs regarding the importance of research to their profession. We also attempted to measure the students' perceived source of authority for clinical decision making (ie, evidence-based practice or anecdotal stories) and their beliefs about how research is viewed by practitioners. Following the initial item determination, a draft of the questionnaire was sent to a panel selected from members of the APTA Section on Research. This panel of experts, selected due to their research knowledge and productivity, reviewed each item for clarity, content validity, and construct validity to ensure that the questions accurately reflected objectives of the study. Based on the expert review, the final questionnaire (Appendix) was developed using a 5-point Likert-type scale that ranged from 1 (strongly agree) to 5 (strongly disagree) to assess the students' degree of agreement with each statement. The final items were formulated to determine whether changes occurred across time.
Data Collection
The 10-item questionnaire was administered on 4 occasions to those students who chose to participate: (1) immediately preceding the students' introduction to the research methods course (N=115), (2) immediately after the completion of that course (n=112), (3) immediately following the second research course, which included statistics and completion of a research proposal (n=92 due to omission of identification numbers by 20 students), and (4) 12 months after graduation (n=34). The participants were able to complete the questionnaire in approximately 5 minutes. The questionnaire also included an identification coding system so that data analysis techniques would be able to track individual students' attitude changes across time. Thirty-four students included the necessary coding number on each of the 4 assessment forms, and their responses were used in the data analysis. The final number of students in the study was low at the time of the final test administration due to (1) our inability to locate some graduates, (2) the failure of some graduates to return the form, and (3) the failure of some graduates to provide an identification number.
Data Analysis
The biostatistical division of the University of Tennessee Health Science Center provided statistical analysis for the study. Demographic characteristics of the entire sample and of those students who completed all 4 phases of the study were analyzed for age by a t test for independent samples and for sex by a chi-square test of independence. The Friedman analysis of variance (ANOVA) was used to analyze the nonparametric data obtained with the Likert-type measurement scale. The Friedman ANOVA was used as an omnibus test to detect differences across time. The .05 alpha level was considered significant for the Friedman ANOVA, the t test for independent samples, and the chi-square test of independence. A follow-up analysis using the Wilcoxon signed-rank procedure to examine differences between baseline data and data obtained during each follow-up was done for all items. For the Wilcoxon signed-rank procedure, Bonferroni adjustments were made and each comparison was tested against an alpha of .17. The SAS system* was used to analyze data from the questionnaire.
| Results |
|---|
|
|
|---|
|
|
|
|
| Discussion |
|---|
|
|
|---|
Items 4 and 5, which we designed to assess students' perceptions of the importance of published research to clinical practice and treatment effectiveness, indicated to us that change occurred in these areas as well. However, for item 4, differences found during the education program were not sustained after 1 year of practice. We speculate that the new graduates may not see evidence-based practice (eg, the application of research to patient care) being applied in the clinical setting. Another possibility was that these new graduates were not supported in their attempts to apply new research findings in the clinical setting and were urged to continue traditional treatment protocols.
Numerous authors1316,19,20 have advocated the need to base clinical treatment methods on what valid and reliable scientific study has demonstrated to be efficacious. However, our findings revealed that professional students, after modifying their beliefs about appropriate sources of authority for treatment decisions during their education, do not sustain their changed beliefs once they are involved in clinical practice. In 1995, Robertson29 reviewed the literature regarding accumulation of a knowledge base in physical therapy and found that clinical or craft-based knowledge was prevalent. She urged that the physical therapy profession increase the emphasis on research-related practice so that more cohesive research programs would be developed. Robertson's assumption that physical therapy practice may be based on informally communicated knowledge bases that have not been critically analyzed seems to be supported by our findings. This trend is disturbing because APTA is striving to have members of the profession support outcomes research and to develop appropriate systems to measure the results of patient or client management.
We used items 7 to 10 to assess the students' perceptions about their professional responsibilities in relation to research and their perceptions about the value to research to physical therapists. None of these items showed a change over time, although a positive change had been noted during the education program. The importance of clinician participation in research has been discussed, but the definition of participation is not always the same.1416,2022 However, APTA's 1996 Practice Profile Report25 indicated that 93.4% of the therapists surveyed reported no work-related involvement with conducting research. Gross et al30 reported that 63% of their sample of physical therapists regularly read Physical Therapy, although only 12.2% reported current involvement in research.
We contend that if clinical physical therapy research is important for the continued growth of the profession, graduates of professional programs with familiarity with the research process must be stimulated to accept the responsibility to use research after graduation as well as during the education program. Unfortunately, despite our hope that student attitudes toward personal involvement in research would improve during their education and be sustained in the clinic, the items on the questionnaire related to personal involvement in research (item 9) and the priority placed on research by physical therapists (item 10) did not change.
Limitations and Recommendations for Future Research
The small response rate of 31% is an obvious limitation of our study. Similar response rates, however, have been noted in 2 other studies that were related to the development of critical appraisal skills in research.26,31 Domholdt et al26 had a response rate of 26.7% from alumni on a comparison of critical appraisal skills by expert and inexperienced physical therapy researchers. An even smaller response rate of 5% was found in medical students who were offered $25 to complete a computer-aided instruction program aimed at improving critical appraisal skills.31 External validity was limited by using a non-randomly selected sample, yet this was done to increase the level of participation by using students in the same professional physical therapy program.26 Commitment to the university has been cited as the primary reason for individuals in a sample to respond to questionnaires.31 Thus, we had hoped to increase the number of subjects responding by using students from our institution.
The use of repeated testing also possibly threatened the external validity of our findings. We developed a new instrument for this project because no survey instrument existed that would yield valid and reliable measurements for students' attitudes regarding research. Survey items used were assessed for clarity and content validity with regard to assessing our stated research course objectives by a panel of members of the APTA Section on Research. The items used were similar to those used in previous APTA membership surveys and in a study of student attitudes.21,23,27,28 However, this instrument was developed to assess a broader range of attitudes on research-related topics. We believe that future research needs to be focused on instruments that can validly and reliably assess educational outcomes in research and other content areas.
In future research on this topic, there should be a larger sample size from a number of different professional physical therapist programs. Evaluating the attributes of the clinical site in which the physical therapist is employed also would give more insight into why some of the beliefs toward research changed once the student was employed in a clinical setting.
| Conclusions |
|---|
|
|
|---|
| Appendix |
|---|
|
|
|---|
|
| Footnotes |
|---|
This study was approved by the Institutional Review Board of the University of Tennessee Health Science Center.
This study was supported in part by the Tennessee Physical Therapy Association.
* SAS Institute Inc, PO Box 8000, Cary, NC 27511. ![]()
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
J. Schreiber, P. Stern, G. Marchetti, and I. Provident Strategies to Promote Evidence-Based Practice in Pediatric Physical Therapy: A Formative Evaluation Pilot Project Physical Therapy, September 1, 2009; 89(9): 918 - 933. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. L. Greenwald Teaching Research Methods in Communication Disorders: A Problem-Based Learning Approach Communication Disorders Quarterly, January 1, 2006; 27(3): 173 - 179. [Abstract] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |