Establishing a valid and reliable tool to evaluate the impact of education interventions on Allied Health clinicians
Katie Palmer1,2, Kelly-Ann Bowles1, Julia Morphet1 1Monash University, 2Monash Health
Abstract
Purpose: Improving clinical practice and the translation of clinical guidelines as part of evidenced based practice in an important concept within Allied Health professions. Clinical education is an important part on ongoing professional development, yet instruments to evaluate the impact of such interventions is limited. The aim of this study was to develop a valid and reliable tool to measure clinician’s self-reported knowledge, confidence, and current practice related to clinical guidelines.
Method: An initial evaluation tool was developed using clinical evidence and knowledge. A content validity index (CVI) analysis was completed on this tool by seven expert participants, with advanced skills in clinical practice, education, and research, to determine validity, clarity, and robustness of both the full tool and individual items. Testing was completed with twenty-eight acute physiotherapists to determine both internal item and whole tool reliability before the item was finalised.
Results: Overall tool CVI was 0.91. All individual item CVI’s met the minimum threshold (0.78) for acceptable relevance and clarity with minor revision. Overall reliability was 0.86. Differences were seen in reliability between junior and senior physiotherapists in sub-group analysis. The tool was finalised including instructions for data interpretation.
Conclusion: This study developed a valid, reliable tool for measuring clinician’s self-reported knowledge, confidence, and referral practices. This tool can be used to measure the impact of interventions to improve evidence-based practice, such as education. It also the potential to be adapted for use across multiple professions, populations, and clinical areas.
Biography
Biography to come.