Intraoperative fluoroscopy skills in distal radius fracture surgery: valid and reliable assessment on a novel immersive virtual reality simulator
DOI:
https://doi.org/10.2340/17453674.2024.41345Keywords:
Competency-Based Medical Education, Distal radius fracture, Fluoroscopy, Surgical education, Virtual reality simulationAbstract
Background and purpose: Orthopedic trainees must be able to perform intraoperative fluoroscopy imaging to assess the surgical result after volar locking plate surgeries of distal radius fractures. Guided by Messick’s contemporary validity framework, the aim of our study was to gather evidence of validity for a test of proficiency for intraoperative imaging of a distal radius fracture using a novel immersive virtual reality simulator.
Methods: 11 novices and 9 experienced surgeons employed at orthopedic departments completed 2 individual simulator sessions. At each session the participants performed 3 repetitions of an intraoperative fluoroscopic control of a distal radius fracture, consisting of 5 different fluoroscopic views. Several performance metrics were automatically recorded by the simulator and compared between the 2 groups.
Results: Simulator metrics for 3 of the 5 fluoroscopic views could discriminate between novices and experienced surgeons. An estimated composite score based on these 3 views showed good test–retest reliability, ICC = 0.82 (confidence interval 0.65–0.92; P < 0.001). A discriminatory standard was set at a composite score of 6.15 points resulting in 1 false positive (i.e., novice scoring better than the standard), and 1 false negative (i.e., experienced surgeon scoring worse than the standard).
Conclusion: This study provided validity evidence from all 5 sources of Messick’s contemporary validity framework (content, response process, internal structure, relationship with other variables, and consequences) for a simulation-based test of proficiency in intraoperative fluoroscopic control of a distal radius fracture fixated by a volar locking plate.
Downloads
References
Viberg B, Tofte S, Rønnegaard A B, Jensen S S, Karimi D, Gundtoft P H. Changes in the incidence and treatment of distal radius fractures in adults: a 22-year nationwide register study of 276,145 fractures. Injury 2023; 54(7): 110802. doi: 10.1016/j.injury.2023.05.033.
Costa M L, Jameson S S, Reed M R. Do large pragmatic randomised trials change clinical practice?: assessing the impact of the Distal Radius Acute Fracture Fixation Trial (DRAFFT). Bone Joint J 2016; 98B(3): 410-13. doi: 10.1302/0301-620X.98B3.36730.
Keil H, Beisemann N, Swartman B, Vetter SY, Grützner P A, Franke J. Intra-operative imaging in trauma surgery. EFORT Open Rev 20183(10): 541-9. doi: 10.1302/2058-5241.3.170074.
Meyer M A, Benavent K A, Chruscielski C M, Janssen S J, Blazar P E, Earp B E. The impact of the Soong Index on hardware removal and overall reoperation rates after volar locking plate fixation of distal radius fractures. J Hand Surg Am 2022; 47(6): 584.e1-584.e9. doi: 10.1016/j.jhsa.2021.06.021.
Bergsma M, Denk K, Doornberg J N, van den Bekerom M P J, Kerkhoffs G M M J, Jaarsma R L, et al. Volar plating: imaging modalities for the detection of screw penetration. J Wrist Surg 2019; 8(6): 520-30. doi: 10.1055/s-0039-1681026.
Oehme F, Schütze K, Björn C L, Frima H, Schepers T, Rhemrev S, et al. Perception of quality of intraoperative fluoroscopy and the influence on postoperative management: an international survey. Eur J Trauma Emerg Surg 2021; 47(3): 1073-9. doi: 10.1007/s00068-019-01286-z.
Rikli D, Goldhahn S, Blauth M, Mehta S, Cunningham M, Joeris A. Optimizing intraoperative imaging during proximal femoral fracture fixation: a performance improvement program for surgeons. Injury 2018; 49(2): 339-44. Doi: 10.1016/j.injury.2017.11.024.
Cook D A, Hatala R, Brydges R, Zendejas B, Szostek J H, Wang A T, et al. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA 2011; 306(9): 978-88. doi: 10.1001/jama.2011.1234.
Sugand K, Wescott R A, Carrington R, Hart A, Van Duren B H. Teaching basic trauma: validating FluoroSim, a digital fluoroscopic simulator for guide-wire insertion in hip surgery. Acta Orthop 2018; 89(4): 380-5. doi: 10.1080/17453674.2018.1466233.
Gustafsson A, Pedersen P, Rømer T B, Viberg B, Palm H, Konge L. Hip-fracture osteosynthesis training: exploring learning curves and setting proficiency standards. Acta Orthop 2019; 90(4): 348-53. doi: 10.1080/17453674.2019.1607111.
Cook D A, Hatala R. Validation of educational assessments: a primer for simulation and beyond. Adv Simul 2016; 1: 31. doi: 10.1186/s41077-016-0033-y.
Validity. In: American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for educational and psychological testing. Washington: American Educational Research Association; 2014. pp. 11-31.
Jacobsen M E, Nayahangan L J, Ghidinelli M, Subramaniam C, Hare K B, Konge L, et al. Assessment of technical competence in distal radius fracture fixation by a volar locking plate: a global Delphi consensus study. J Hand Surg Am 2023; 48(9): 875-85. doi: 10.1016/j.jhsa.2023.05.012.
Yudkowsky R, Downing S M, Tekian A. Standard setting. In: Yudkowsky R, Park YS, Downing SM, editors. Assessment in health professions education. New York: Routledge; 2020. p. 86-105.
Pietersen P I, Bjerrum F, Tolsgaard M G, Konge L, Andersen S A W. Standard setting in simulation-based training of surgical procedures: a systematic review. Ann Surg 2022; 275(5): 872-82. doi: 10.1097/SLA.0000000000005209.
Langerhuizen D W G, Bergsma M, Selles C A, Jaarsma R L, Goslings J C, Schep N W L, et al. Diagnosis of dorsal screw penetration after volar plating of a distal radial fracture: intraoperative dorsal tangential views versus 3D fluoroscopy. Bone Joint J 2020; 102(7): 874-80. doi: 10.1302/0301-620X.102B7.BJJ-2019-1489.R1.
Bergsma M, Bulstra A E, Morris D, Janssen M, Jaarsma R, Doornberg J. A Prospective cohort study on accuracy of dorsal tangential views to avoid screw penetration with volar plating of distal radius fractures. J Orthop Trauma 2020; 34(9): E291-E297. doi: 10.1097/BOT.0000000000001763.
Jensen J, Tromborg H B, Rasmussen B S B, Gerke O, Torfing T, Precht H, et al. The effect of forearm rotation on radiographic measurements of the wrist: an experimental study using radiostereometric analyses on cadavers. Eur Radiol Exp 2021; 5(1): 5. doi: 10.1186/s41747-021-00209-1.
Frane N, Megas A, Stapleton E, Ganz M, Bitterman A D. Radiation exposure in orthopaedics. JBJS Rev 2020; 8(1): e0060 doi: 10.2106/JBJS.RVW.19.00060.
Matityahu A, Duffy R K, Goldhahn S, Joeris A, Richter P H, Gebhard F. The great unknown: a systematic literature review about risk associated with intraoperative imaging during orthopaedic surgeries. Injury 2017; 48(8): 1727-34. doi: 10.1016/j.injury.2017.04.041.
Malik A T, Rai H H, Lakdawala R H, Noordin S. Does surgeon experience influence the amount of radiation exposure during orthopedic procedures? A systematic review. Orthop Rev (Pavia) 2019; 11(1): 7667. doi: 10.4081/or.2019.7667.
Gendelberg D, Hennrikus W, Slough J, Armstrong D, King S. A radiation safety training program results in reduced radiation exposure for orthopaedic residents using the mini C-arm. Clin Orthop Relat Res 2016; 474(2): 580-4. doi: 10.1007/S11999-015-4631-0.
Baumgartner R, Libuit K, Ren D, Bakr O, Singh N, Kandemir U, et al. Reduction of radiation exposure from C-arm fluoroscopy during orthopaedic trauma operations with introduction of real-time dosimetry. J Orthop Trauma 2016; 30(2): e53-e58. doi: 10.1097/BOT.0000000000000442.
Delma S, Ozdag Y, Manzar S, Koussaify J E, Foster B K, Akoon A, et al. The effect of an intraoperative real-time counter on radiation exposure events during operative treatment of distal radius fractures. J Hand Surg Am 2023; 48(11): 1105-13. doi: 10.1016/j.jhsa.2023.07.013.
Su P, Zhu Z, He J, He R, Feng H, Du P, et al. Focus on radiation protection improves both correct behavior and procedural performance during simulation-based training: a randomized comparison. Ann Vasc Surg 2023; 89: 302-311. doi: 10.1016/j.avsg.2022.10.003.
Gustafsson A, Rölfing J D, Palm H, Viberg B, Grimstrup S, Konge L. Setting proficiency standards for simulation-based mastery learning of short antegrade femoral nail osteosynthesis: a multicenter study. Acta Orthop 2024; 95: 275-81. doi: 10.2340/17453674.2024.40812.
Additional Files
Published
How to Cite
License
Copyright (c) 2024 Marie Sønderup, Amandus Gustafsson, Lars Konge, Mads Emil Jacobsen
This work is licensed under a Creative Commons Attribution 4.0 International License.
