Editorial

Changing peer review practices: transforming roles and future challenges

Serge P J M HORBACH 1 and Søren OVERGAARD 2

1 Institute for Science in Society, Radboud University, Netherlands; 2 Copenhagen University Hospital Bispebjerg, Department of Orthopaedic Surgery and Traumatology, University of Copenhagen, Denmark

 

Citation: Acta Orthopaedica 2025; 96: 537–539. DOI: https://doi.org/10.2340/17453674.2025.44353.

Copyright: © 2025 The Author(s). Published by MJS Publishing – Medical Journals Sweden, on behalf of the Nordic Orthopedic Federation. This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0/)

Published: 2025-07-18.

Correspondence: serge.horbach@ru.nl

Authors report no conflict of interests. Complete disclosure of interest forms according to ICMJE are available on the article page, doi: 10.2340/17453674.2025.44353

Handling co-editor: Li Felländer-Tsai

 

The peer review process in the past and present

Despite many critiques of the system being slow, biased, expensive, and not always effective in distinguishing good from problematic research [1-3], peer review is still considered the hallmark of scholarly communication practices. By many, it is even considered a defining element of science.

While it tends to be referred to as a single procedure, the peer review system has historically been characterized by a wide diversity of practices and procedures [4,5]. Starting off from a procedure to select manuscripts worthy of publication within the limited number of pages of journals, usually performed by an individual editor in chief or small editorial board, the system began introducing external reviewers as science diversified and specialized [6]. Acta Orthopaedica started with external reviewers in 1971. Specialized reviewers were required for their expertise to assess increasingly niche topics, which could no longer be done by a small group of editors.

With the introduction of external reviewers [7], various concerns that needed to be tackled emerged. This included concerns over fairness and bias, diversity, and proper recognition [8-10]. Such concerns led to a diversification of review procedures, with journals either using single, double, or even triple anonymous review procedures [11], and recently also using open review procedures in which identities of those involved or the content of the review reports are openly disclosed [12]. Acta Orthopaedica also engages in these practices, disclosing reviewer identities in published articles, unless reviewers actively opt out. In addition, procedures to tackle conflicts of interest, attempts to provide recognition and reward for reviewers, or formats using diverse review criteria have led to further experimentation with review and editorial procedures [13].

Ultimately, these all relate to the questions of who is a qualified reviewer, what should be reviewed, and how can this best be done. Such concerns remain very timely and relevant today, for example when increased levels of interdisciplinarity and single manuscripts crossing disciplinary boundaries raise the question of who can rightfully be considered a “peer,” sufficiently qualified to assess a manuscript.

Changing editorial practices

So, even if editorial practices have never been homogeneous, scholarly peer review is currently witnessing another wave of many and rapid transformations, increasingly fueled by developments in AI and other technologies.

With the introduction of novel, mostly AI-based technologies, another wave of developments and variations may be possible in the future. These technologies have been implemented to support or conduct various “technical” checks including those for text and image duplication [14], inappropriate references, alignment with reporting standards, and errors in statistical analyses or reporting [15]. However, these tools are also increasingly being used for other tasks, including some that directly relate to the content or process of manuscript peer review. Think for example of tasks like selecting appropriate reviewers [16], writing review reports, or analyzing manuscripts to identify strengths and weaknesses [17].

These new technologies and tools have several obvious advantages, and they potentially address several long-standing challenges of the peer review system. This includes reducing the time required for initial checks, enhancing the detection of plagiarism or other research misbehaviors, and addressing the issue of reviewer fatigue [18,19]. In several ways, these tools have the potential to contribute to fighting research misconduct and boosting efficiency, leading some to argue that a fully automated future of editorial processes may be on the horizon [20]. However, the ability of large language models to write high-quality reviews is still hotly debated [17].

Apart from efficiency considerations, these technologies also have more fundamental implications. One of them comprises a restructuring of the roles and responsibilities of actors involved in the review and editorial process. Editors, who traditionally managed the entire review process, now share responsibilities with automated systems that can handle initial checks and reviewer selection. This shift allows editors to focus more on strategic decisions and the overall direction of the journal, but also brings risks in terms of quality and integrity [21].

Reviewers, on the other hand, may find their roles shifting towards more interpretative and evaluative tasks, as routine checks are automated. This could contribute to yet another wave of specialization of the review process, with reviewers contributing to the assessment of more specific aspects of manuscripts. Potentially, this can lead to a more efficient use of their expertise, and some claim it would lead to more objective review [22]. However, these tools also introduce new dynamics in defining what constitutes quality and integrity in research [16]. They implicitly set benchmarks for originality, relevance, and adherence to reporting standards, all informed by their training data and therefore necessarily reproducing past quality standards [19].

Diverse implications for diverse journals

For several reasons, we might expect the emergence of these new technologies to play out differently for diverse journals.

First, we should note that the availability of these systems and tools is not equally distributed over academic outlets. As they tend to require substantial resources and investments, their availability remains largely restricted to large, typically commercial, publishers or other well-resourced journals. New AI tools, such as ChatGPT or other general-purpose tools, are sometimes freely available, but they come with the risk of breaching confidentiality as they use input for training data. Alternatively, in-house models can be created, or company protection services can be negotiated, but these require substantial resources that are only available to some publishers or journals.

With quality checks and efficient handling of papers being prime markers of journal “quality” [23], this skewed ability to integrate new tools in editorial processes runs the risk of strengthening the monopoly position of large publishers to the detriment of smaller, community-owned journals and publishers [24].

From the perspective of the Acta Orthopaedica editorial team, we want to be efficient, fair, and produce high-quality reviews. Only those manuscripts with a fair chance of being published should go into review. This requires a good screening process. The journal currently has the possibility to perform plagiarism checks on each manuscript and would be interested in tools for research integrity checks, such as checking for fabrication of data and potential involvement of paper mills. All the tools should protect the manuscript and safeguard confidentiality. If implemented well, these tools will make the editorial processes more homogeneous and efficient. Regarding the review process, better screening tools for use on reporting guidelines, registration of protocols, and statistical analysis plans would be helpful.

AI and other technologies will have their role in the future peer-review process, which has to be defined and developed, including how to implement it in medical writing [25]. However, the valuable work done by editors and reviewers will still be needed.

  1. Biagioli M. From book censorship to academic peer review. Emergences J Study Media Compos Cult 2002; 12(1): 11-45. doi: 10.1080/1045722022000003435.
  2. Csiszar A. Peer review: troubled from the start. Nature 2016; 532: 306-8. doi: 10.1038/532306a.
  3. Smith R. Peer review: a flawed process at the heart of science and journals. J R Soc Med 2006; 99(4): 178-82. doi: 10.1177/014107680609900414.
  4. Fyfe A, Gielas A. Introduction: Editorship and the editing of scientific journals, 1750–1950. Centaurus 2020; 62(1): 5-20. doi: 10.1111/1600-0498.12290.
  5. Horbach S P J M, Halffman W. The changing forms and expectations of peer review. Res Integr Peer Rev 2018; 3(1): 8. doi: 10.1186/s41073-018-0051-5.
  6. Csiszar A. The scientific journal: authorship and the politics of knowledge in the nineteenth century. Chicago: University of Chicago Press; 2018. ISBN 9780226752501.
  7. Baldwin M. Credibility, peer review, and nature, 1945–1990. Notes Rec R Soc J Hist Sci 2015; 69(3): 337-52. doi: 10.1098/rsnr.2015.0029.
  8. Haffar S, Bazerbachi F, Murad M H. Peer review bias: a critical review. Mayo Clin Proc 2019; 94(4) :670-6. doi: 10.1016/j.mayocp.2018.09.004.
  9. Lee C J, Sugimoto C R, Zhang G, Cronin B. Bias in peer review. J Assoc Inf Sci Technol 2013; 64(1): 2-17. doi: 10.1002/asi.22784.
  10. Peters D P, Ceci S J. Peer-review practices of psychological journals: the fate of published articles, submitted again. Behav Brain Sci 1982; 5(2): 187-95. doi: 10.1017/S0140525X00011183.
  11. Pontille D, Torny D. The blind shall see! The question of anonymity in journal peer review. Ada J Gend New Media Technol 2014; 4. doi: 10.7264/N3542KVW.
  12. Ross-Hellauer T, Horbach S P J M. Additional experiments required: a scoping review of recent evidence on key aspects of Open Peer Review. Res Eval 2024; 33: rvae004. doi: 10.31222/osf.io/r6t8p.
  13. Tennant J P, Ross-Hellauer T. The limitations to our understanding of peer review. Res Integr Peer Rev 2020; 5(1): 6. doi: 10.1186/s41073-020-00092-1.
  14. Hesselmann F. A Tale of two academic communities: digital imaginaries of automatic screening tools in editorial practice. Minerva [Internet] 2023; 61: 221-41. doi: 10.1007/s11024-022-09484-7.
  15. Epskamp S, Nuijten M. statcheck: Extract statistics from articles and recompute p values (R package version 1.0. 0.). 2014. https://research.tilburguniversity.edu/en/publications/statcheck-extract-statistics-from-articles-and-recompute-p-values
  16. Hesselmann F, Hartstein J. Creating interpretative spaces in and with digital infrastructures: how editors select reviewers at a biomedical publisher. Sci Technol Hum Values 2025; 50(1): 12-39. doi: 10.1177/0162243924125.
  17. Naddaf M. AI is transforming peer review—and many scientists are worried. Nature 2025; 639(8056): 852-4. doi: 10.1038/d41586-025-00894-7.
  18. Bauchner H, Rivara F P. Use of artificial intelligence and the future of peer review. Health Aff Sch 2024; 2(5): qxae058. doi: 10.1093/haschl/qxae058.
  19. Hosseini M, Horbach S P J M. Fighting reviewer fatigue or amplifying bias? Considerations and recommendations for use of ChatGPT and other large language models in scholarly peer review. Res Integr Peer Rev 2023; 8(1): 4. doi: 10.1186/s41073-023-00133-5.
  20. Irfanullah H. Peer review has lost its human face. So, what’s next? [Internet]. Scholarly Kitchen 2025 [cited 2025 Apr 15]. Available from: https://scholarlykitchen.sspnet.org/2025/04/09/peer-review-has-lost-its-human-face-so-whats-next/
  21. Horbach S P J M, Ochsner M, Kaltenbrunner W. Reflections on guest editing a Frontiers journal [Internet]. Leiden Madtrics 2022. Available from: https://www.leidenmadtrics.nl/articles/reflections-on-guest-editing-a-frontiers-journal
  22. Chauhan C, Currie G. The impact of generative artificial intelligence on the external review of scientific manuscripts and editorial peer review processes. Am J Pathol 2024; 194(10): 1802-6. doi: 10.1016/j.ajpath.2024.08.002.
  23. Wang J, Halffman W, Horbach S P J M. The journal attention cycle: indicators as assets in the Chinese scientific publishing economy. Sci Technol Hum Values 2025; 01622439251322530. doi: 10.31222/osf.io/6uvpz.
  24. Larivière V, Haustein S, Mongeon P. The oligopoly of academic publishers in the digital era. PLOS One 2015; 10(6): e0127502. doi: 10.1371/journal.pone.0127502.
  25. Felländer-Tsai L, Overgaard S. Adapting to the rapidly moving target artificial intelligence (AI) in scholarly publishing. Acta Orthop 2023; 94: 625. doi: 10.2340/17453674.2023.34900.