Safety notices and registry outlier data measure different aspects of safety and performance of total knee implants: a comparative study of safety notices and register outliers
DOI:
https://doi.org/10.2340/17453674.2024.42361Keywords:
Arthroplasty registries, Knee, Outliers, Performance, Real-world data, Safety noticesAbstract
Background and purpose: Safety notices for medical devices such as total knee arthroplasty (TKA) implants may indicate problems in their design or performance that require corrective action to prevent patient harm. Safety notices are often published on national Ministries of Health or regulatory agencies websites. It is unknown whether problems triggering safety notices identify the same implants as those identified by registries as “outlier.” We aimed to assess the extent to which safety notices and outlier identification in registries signal the same or different TKA implants.
Methods: The CORE-MD tool, an automated web scraper tool, was used to collect safety notices related to TKA implants on 13 national Ministries of Health websites and regulatory agencies. Safety notices were defined according to the Medical Device Regulation (MDR) as “a communication sent by a manufacturer to users or customers in relation to a field safety corrective action.” Identified TKA outliers, defined as having a significantly higher revision risk than other comparable TKA implants, were extracted from registry reports.
Results: 787 safety notices for 38 TKA implants and 35 TKA outliers were identified, together identifying 47 unique TKA implants. 26 (55%) TKA implants had safety notices and were also outliers, 12 (26%) TKA implants had only safety notices, and 9 (19%) were outliers only. TKA implants with safety notices only had similar types of problems to TKA outliers with safety notices, with “Manufacturing/Packaging/Shipping” problems being most frequent (44%). Cumulative revision risks (1/5/10 years) were lower for TKA implants with safety notices only than for TKA outliers with safety notices.
Conclusion: 55% of the TKA with a safety notice were identified as outliers in the registry, whereas around 25% of TKA outliers are not the subject of publicly released safety notices, with safety notices pointing to TKA implants not identified by registries as potentially having a higher risk of failure. This suggests that safety notices and registry outlier data measure different aspects of safety and performance.
Downloads
References
Medical Device Regulation (MDR). MDR – Article 83 – Post-market surveillance system of the manufacturer. Available from: https://www.medical-device-regulation.eu/tag/mdr-article-83-post-market-surveillance-system-of-the-manufacturer/ (last accessed February 23, 2024).
Medical Device Regulation (MDR). MDR – Article 87 – Reporting of serious incidents and field safety corrective actions. Available from: https://www.medical-device-regulation.eu/2019/07/16/mdr-article-87-reporting-of-serious-incidents-and-field-safety-corrective-actions/ (last accessed February 23, 2024).
Hoogervorst L A, Geurkink T H, Lübbeke A, Buccheri S, Schoones J W, Torre M, et al. Quality and utility of European cardiovascular and orthopaedic registries for the regulatory evaluation of medical device safety and performance across the implant lifecycle: a systematic review. Int J Health Policy Manag 2023; 12: 7648. doi: 10.34172/ijhpm.2023.7648. DOI: https://doi.org/10.34172/ijhpm.2023.7648
de Steiger R N, Miller L N, Davidson D C, Philip R, Graves S E. Joint registry approach for identification of outlier prostheses. Acta Orthop 2013; 84(4): 348-52. doi: 10.3109/17453674.2013.831320. DOI: https://doi.org/10.3109/17453674.2013.831320
Puijk R, Sierevelt I N, Pijls B G C W, Spekenbrink-Spooren A, Nolte P A. Increased risk of aseptic loosening for posterior stabilized compared with posterior cruciate-retaining uncemented total knee replacements: a cohort study of 13,667 knees from the Dutch Arthroplasty Registry. Acta Orthop 2023; 94: 600-6. doi: 10.2340/17453674.2023.33283. DOI: https://doi.org/10.2340/17453674.2023.33283
Enhancing the QUAlity and Transparency Of health Research. STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. Available from : https://www.equator-network.org/wp-content/uploads/2015/03/STARD-2015-checklist.pdf (last accessed November 5, 2024).
Ren Y, Bertoldi M, Fraser A G, Caiani E G. Validation of CORE-MD PMS support tool: a novel strategy for aggregating information from notices of failures to support medical devices’ post-market surveillance. Ther Innov Regul Sci 2023; 57(3): 589-602. doi: 10.1007/s43441-022-00493-y. DOI: https://doi.org/10.1007/s43441-022-00493-y
American Joint Replacement Registry (AJRR). The American Joint Replacement Registry Annual Report 2023. Available: https://www.aaos.org/registries/publications/ajrr-annual-report/ (last accessed November 6, 2024).
Australian Orthopaedic Association National Joint Replacement Registry (AOANJRR). Other Registries Worldwide. Available from: https://aoanjrr.sahmri.com/registries (last accessed November 5, 2024).
Dutch Arthroplasty Register (LROI). Online LROI annual report 2023. Available from: https://www.lroi-report.nl/app/uploads/2023/10/PDF-LROI-annual-report-2023-1.pdf (last accessed November 5, 2024).
Regional Register of Orthopaedic Prosthetic Implantology (RIPO) overall data hip, knee and shoulder arthroplasty in Emilia-Romagna region (Italy) 2000–2020. Available from: https://ripo.cineca.it/authzssl/pdf/Annual%20report%202020%20Regione%20Emilia%20-%20Romagna.pdf (last accessed November 5, 2024).
Endoprothesenregister Deutschland (EPRD). Annual Report 2022. Available from : https://www.eprd.de/en/downloads/reports (last accessed November 5, 2024).
Schweizerisches implantat-register registre suisse des implants (SIRIS). Swiss National Hip & Knee Joint Registry Report 2023. Available from: https://www.swiss-medtech.ch/sites/default/files/2023-11/231117_SIRIS-Report-2023_Final_online.pdf (last accessed November 5, 2024).
National Joint Registry (NJR). 20th Annual Report. Available from: https://reports.njrcentre.org.uk/ (last accessed November 5, 2024).
Finnish Arthroplasty register (FAR). Available from: https://www.thl.fi/far/#index. (data until March 2021).
International Medical Device Regulators Forum (IMDRF). IMDRF terminologies for categorized adverse event reporting (AER): terms, terminology structure and codes. Available from: https://www.imdrf.org/sites/default/files/docs/imdrf/final/technical/imdrf-tech-200318-ae-terminologies-n43.pdf (last accessed February 23, 2024).
International Medical Device Regulators Forum (IMDRF). Annex A: Medical device problem. Available from: https://www.imdrf.org/working-groups/adverse-event-terminology/annex-medical-device-problem (last accessed February 23, 2024).
McHugh M L. Interrater reliability: the kappa statistic. Biochem Med (Zagreb) 2012; 22(3): 276-82. PMID: 23092060 DOI: https://doi.org/10.11613/BM.2012.031
Australian Orthopaedic Association National Joint Replacement Registry (AOANJRR). Other Registries Worldwide. Available from: https://aoanjrr.sahmri.com/registries (last accessed February 23, 2024).
de Steiger R N, Hallstrom B R, Lübbeke A, Paxton E W, van Steenbergen L N, Wilkinson M. Identification of implant outliers in joint replacement registries. EFORT Open Rev 2023; 8(1): 11-17. doi: 10.1530/EOR-22-0058. DOI: https://doi.org/10.1530/EOR-22-0058
Hozo S P, Djulbegovic B, Hozo I. Estimating the mean and variance from the median, range, and the size of a sample. BMC Med Res Methodol 2005; 5: 13. doi: 10.1186/1471-2288-5-13. DOI: https://doi.org/10.1186/1471-2288-5-13
Phillips J R A, Tucker K. Implant brand portfolios, the potential for camouflage of data, and the role of the Orthopaedic Data Evaluation Panel in total knee arthroplasty. Bone Joint J 2021; 103-b(10): 1555-60. doi: 10.1302/0301-620X.103B10.BJJ-2021-0284.R1. DOI: https://doi.org/10.1302/0301-620X.103B10.BJJ-2021-0284.R1
Pane J, Verhamme K M C, Villegas D, Gamez L, Rebollo I, Sturkenboom M C J M. Challenges associated with the safety signal detection process for medical devices. Med Devices (Auckl) 2021; 14: 43-57. doi: 10.2147/MDER.S278868. DOI: https://doi.org/10.2147/MDER.S278868
Wilton T, Skinner J A, Haddad F S. Camouflage uncovered: what should happen next? Bone Joint J 2023; 105-b(3): 221-6. doi: 10.1302/0301-620X.105B3.BJJ-2023-0145. DOI: https://doi.org/10.1302/0301-620X.105B3.BJJ-2023-0145
van Schie P, Hasan S, van Bodegom-Vos L, Schoones J W, Nelissen R G H H, Marang-van de Mheen P J. International comparison of variation in performance between hospitals for THA and TKA: is it even possible? A systematic review including 33 studies and 8 arthroplasty register reports. EFORT Open Rev 2022; 7(4): 247-63. doi: 10.1530/EOR-21-0084. DOI: https://doi.org/10.1530/EOR-21-0084
Hoogervorst L A, van Tilburg M M, Lübbeke A, Wilton T, Nelissen R G H H, Marang-van de Mheen P J. Validating Orthopaedic Data Evaluation Panel (ODEP) ratings across 9 orthopaedic registries: total hip implants with an ODEP rating perform better than those without an ODEP rating. J Bone Joint Surg Am 2024; 106(17): 1583-93. doi: 10.2106/JBJS.23.00793. DOI: https://doi.org/10.2106/JBJS.23.00793
Robertsson O, Lidgren L, Sundberg M, W-Dahl A. The Swedish Knee Arthroplasty Register: annual report 2020. Available from: https://www.myknee.se/pdf/SVK_2020_Eng_1.0.pdf (last accessed November 5, 2024).
Medicines & Healthcare products Regulatory Agency (MHRA). First generation JOURNEY BCS Knee System: higher than expected risk of revision. Available from: https://www.cas.mhra.gov.uk/ViewandAcknowledgment/ViewAttachment.aspx?Attachment_id=103076#:~:text=In%20June%202018%2C%20Smith%20%26%20Nephew,main%20cause%20of%20device%20failure (last accessed November 5, 2024).
Additional Files
Published
How to Cite
License
Copyright (c) 2024 Lotje A Hoogervorst, Yijun Ren, Tom Melvin, Ashley A Stratton-Powell, Anne Lübbeke, Robert E Geertsma, Alan G Fraser, Rob G H H Nelissen, Enrico G Caiani, Perla J Marang-van de Mheen
This work is licensed under a Creative Commons Attribution 4.0 International License.
