Archive \ Volume.16 2025 Issue 4

Medication-Safety Algorithms in Hospital Pharmacy between 2017 and 2025: A Systematic Review of Clinical Tasks and Evaluation Methods

, ,
  1. Department of Hospital Pharmacy and Medication Safety, Faculty of Pharmacy, University of Tunis, Tunis, Tunisia.
  2. Department of Algorithm Evaluation in Clinical Pharmacy, Faculty of Pharmacy, University of Sfax, Sfax, Tunisia.

Abstract

Hospital-pharmacy algorithms are used to identify atypical prescriptions, prioritize pharmacist review, filter medication alerts, and estimate medication-related risk. Their credibility depends on how tasks, labels, comparators, validation, and workflow consequences are evaluated. To review systematically the clinical tasks and evaluation methods used for hospital-pharmacy medication-safety algorithms published from 2017 through 2025. This PRISMA 2020-aligned systematic methodological review searched major biomedical and multidisciplinary databases and citation chains. Eligible Q1 journal studies evaluated an algorithm relevant to hospital medication safety or pharmacist medication review. Duplicate independent screening, structured extraction, PROBAST-informed appraisal, and narrative synthesis examined task definition, data source, reference standard, validation, comparator, performance metrics, calibration, uncertainty, interpretability, workflow, safety, equity, and reproducibility.

Sixty-three records were identified; eight duplicates were removed, 55 records were screened, and 40 reports underwent full-text assessment. Seventeen reports were excluded, leaving 23 studies for qualitative synthesis and none for quantitative synthesis. Studies addressed prescription-error detection, review prioritization, atypical-order identification, alert optimization, and adverse-event risk. Retrospective single-centre evaluation predominated; external validation, calibration analysis, prospective workflow comparison, subgroup error assessment, and reproducibility reporting were uncommon. The literature shows technical diversity but uneven methodological credibility. Discrimination or alert yield alone does not establish clinical usefulness, safety, equity, or implementation readiness. Stronger reference standards, independent validation, calibrated thresholds, prospective workflow testing, and explicit error-consequence analysis are required.


Downloads: 26
Views: 70

How to cite:
Vancouver
Ben Ali A, Gharbi S, Jebali N. Medication-Safety Algorithms in Hospital Pharmacy between 2017 and 2025: A Systematic Review of Clinical Tasks and Evaluation Methods. Arch Pharm Pract. 2025;16(4):54-63. https://doi.org/10.51847/DK74gof42o
APA
Ben Ali, A., Gharbi, S., & Jebali, N. (2025). Medication-Safety Algorithms in Hospital Pharmacy between 2017 and 2025: A Systematic Review of Clinical Tasks and Evaluation Methods. Archives of Pharmacy Practice, 16(4), 54-63. https://doi.org/10.51847/DK74gof42o

Download Citation
References
  1. Hatzimanolis J, Riley B, El-Den S, Aslani P, Zhou J, Chaar BB. Applications of artificial intelligence in current pharmacy practice: A scoping review. Res Social Adm Pharm. 2025;21(3):134-41. doi:10.1016/j.sapharm.2024.12.007
  2. Ranchon F, Chanoine S, Lambert-Lacroix S, Bosson JL, Moreau-Gaudry A, Bedouch P. Development of artificial intelligence powered apps and tools for clinical pharmacy services: A systematic review. Int J Med Inform. 2023;172:104983. doi:10.1016/j.ijmedinf.2022.104983
  3. Graafsma J, Murphy RM, van de Garde EMW, Karapinar-Çarkit F, Derijks HJ, Hoge RHL, et al. Artificial intelligence to optimize medication alerts generated by clinical decision support systems: A scoping review. J Am Med Inform Assoc. 2024;31(6):1411-22. doi:10.1093/jamia/ocae076
  4. Sutton RT, Pincock D, Baumgart DC, Sadowski DC, Fedorak RN, Kroeker KI. An overview of clinical decision support systems: Benefits, risks, and strategies for success. NPJ Digit Med. 2020;3:17. doi:10.1038/s41746-020-0221-y
  5. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ. 2021;372. doi:10.1136/bmj.n71
  6. Page MJ, Moher D, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. PRISMA 2020 explanation and elaboration: Updated guidance and exemplars for reporting systematic reviews. BMJ. 2021;372. doi:10.1136/bmj.n160
  7. Rethlefsen ML, Kirtley S, Waffenschmidt S, Ayala AP, Moher D, Page MJ, et al. PRISMA-S: An extension to the PRISMA statement for reporting literature searches in systematic reviews. Syst Rev. 2021;10(1):39. doi:10.1186/s13643-020-01542-z
  8. Wolff RF, Moons KGM, Riley RD, Whiting PF, Westwood M, Collins GS, et al. PROBAST: A tool to assess the risk of bias and applicability of prediction model studies. Ann Intern Med. 2019;170(1):51-8. doi:10.7326/M18-1376
  9. Moons KGM, Wolff RF, Riley RD, Whiting PF, Westwood M, Collins GS, et al. PROBAST: A tool to assess risk of bias and applicability of prediction model studies: Explanation and elaboration. Ann Intern Med. 2019;170(1). doi:10.7326/M18-1377
  10. Laatikainen O, Miettunen J, Sneck S, Lehtiniemi H, Tenhunen O, Turpeinen M. Medication-related adverse events in health care—what have we learned? A narrative overview of the current knowledge. Eur J Clin Pharmacol. 2022;78(2):159-70. doi:10.1007/s00228-021-03213-x
  11. Bates DW, Levine DM, Salmasian H, Syrowatka A, Shahian DM, Lipsitz S, et al. The safety of inpatient health care. N Engl J Med. 2023;388(2):142-53. doi:10.1056/NEJMsa2206117
  12. Wong A, Plasek JM, Montecalvo SP, Zhou L. Natural language processing and its implications for the future of medication safety: A narrative review of recent advances and challenges. Pharmacotherapy. 2018;38(8):822-41. doi:10.1002/phar.2151
  13. van de Schoot R, de Bruin J, Schram R, Zahedi P, de Boer J, Weijdema F, et al. An open source machine learning framework for efficient and transparent systematic reviews. Nat Mach Intell. 2021;3(2):125-33. doi:10.1038/s42256-020-00287-7
  14. Marshall IJ, Wallace BC. Toward systematic review automation: A practical guide to using machine learning tools in research synthesis. Syst Rev. 2019;8(1):163. doi:10.1186/s13643-019-1074-9
  15. Hicks SA, Strümke I, Thambawita V, Hammou M, Riegler MA, Halvorsen P, et al. On evaluation metrics for medical applications of artificial intelligence. Sci Rep. 2022;12(1):5979. doi:10.1038/s41598-022-09954-8
  16. Kelly CJ, Karthikesalingam A, Suleyman M, Corrado G, King D. Key challenges for delivering clinical impact with artificial intelligence. BMC Med. 2019;17(1):195. doi:10.1186/s12916-019-1426-2
  17. Schiff GD, Volk LA, Volodarskaya M, Williams DH, Walsh L, Myers SG, et al. Screening for medication errors using an outlier detection system. J Am Med Inform Assoc. 2017;24(2):281-7. doi:10.1093/jamia/ocw171
  18. Segal G, Segev A, Brom A, Lifshitz Y, Wasserstrum Y, Zimlichman E. Reducing drug prescription errors and adverse drug events by application of a probabilistic, machine-learning based clinical decision support system in an inpatient setting. J Am Med Inform Assoc. 2019;26(12):1560-5. doi:10.1093/jamia/ocz135
  19. Corny J, Rajkumar A, Martin O, Dode X, Lajonchère JP, Billuart O, et al. A machine learning-based clinical decision support system to identify prescriptions with a high risk of medication error. J Am Med Inform Assoc. 2020;27(11):1688-94. doi:10.1093/jamia/ocaa154
  20. Santos HDP, Ulbrich AHDPS, Woloszyn V, Vieira R. DDC-Outlier: Preventing medication errors using unsupervised learning. IEEE J Biomed Health Inform. 2019;23(2):874-81. doi:10.1109/JBHI.2018.2828028
  21. Hogue SC, Chen F, Brassard G, Lebel D, Bussières JF, Thibault M. Pharmacists’ perceptions of a machine learning model for the identification of atypical medication orders. J Am Med Inform Assoc. 2021;28(8):1712-8. doi:10.1093/jamia/ocab071
  22. Balestra M, Chen J, Iturrate E, Aphinyanaphongs Y, Nov O. Predicting inpatient pharmacy order interventions using provider action data. JAMIA Open. 2021;4(3). doi:10.1093/jamiaopen/ooab083
  23. Lee S, Shin J, Kim HS, Lee MJ, Yoon JM, Lee S, et al. Hybrid method incorporating a rule-based approach and deep learning for prescription error prediction. Drug Saf. 2022;45(1):27-35. doi:10.1007/s40264-021-01123-6
  24. Poly TN, Islam MM, Muhtar MS, Yang HC, Nguyen PAA, Li YJ. Machine learning approach to reduce alert fatigue using a disease medication-related clinical decision support system: Model development and validation. JMIR Med Inform. 2020;8(11). doi:10.2196/19489
  25. Liu S, Kawamoto K, Del Fiol G, Fiszman M, Weir C, Reese T, et al. The potential for leveraging machine learning to filter medication alerts. J Am Med Inform Assoc. 2022;29(5):891-9. doi:10.1093/jamia/ocab292
  26. Levivien C, Cavagna P, Grah A, Buronfosse A, Courseau R, Bézie Y, et al. Assessment of a hybrid decision support system using machine learning with artificial intelligence to safely rule out prescriptions from medication review in daily practice. Int J Clin Pharm. 2022;44(2):459-65. doi:10.1007/s11096-021-01366-4
  27. Yalçın N, Kaşıkcı M, Çelik HT, Allegaert K, Demirkan K, Yiğit Ş, et al. Development and validation of a machine learning-based detection system to improve precision screening for medication errors in the neonatal intensive care unit. Front Pharmacol. 2023;14:1151560. doi:10.3389/fphar.2023.1151560
  28. Nagata K, Nakamura M, Yamamoto N, Tsuji T, Watanabe H, Ishikawa T, et al. Detection of overdose and underdose prescriptions—an unsupervised machine learning approach. PLoS One. 2021;16(11). doi:10.1371/journal.pone.0260315
  29. Imai S, Takekuma Y, Kashiwagi H, Miyai T, Kobayashi M, Iseki K, et al. Validation of the usefulness of artificial neural networks for risk prediction of adverse drug reactions used for individual patients in clinical practice. PLoS One. 2020;15(7). doi:10.1371/journal.pone.0236789
  30. Van Laere S, Muylle KM, Dupont AG, Cornu P. Machine learning techniques outperform conventional statistical methods in the prediction of high risk QTc prolongation related to a drug-drug interaction. J Med Syst. 2022;46(12):100. doi:10.1007/s10916-022-01890-4
  31. Hu Q, Wu B, Wu J, Xu T. Predicting adverse drug events in older inpatients: A machine learning study. Int J Clin Pharm. 2022;44(6):1304-11. doi:10.1007/s11096-022-01468-7
  32. King CR, Abraham J, Fritz BA, Cui Z, Galanter W, Chen Y, et al. Predicting self-intercepted medication ordering errors using machine learning. PLoS One. 2021;16(7). doi:10.1371/journal.pone.0254358
  33. Lewin-Epstein O, Baruch S, Hadany L, Stein GY, Obolski U. Predicting antibiotic resistance in hospitalized patients by applying machine learning to electronic medical records. Clin Infect Dis. 2021;72(11). doi:10.1093/cid/ciaa1576
  34. Wongyikul P, Thongyot N, Tantrakoolcharoen P, Seephueng P, Khumrin P. High alert drugs screening using gradient boosting classifier. Sci Rep. 2021;11(1):20132. doi:10.1038/s41598-021-99505-4
  35. Langenberger B. Machine learning as a tool to identify inpatients who are not at risk of adverse drug events in a large dataset of a tertiary care hospital in the USA. Br J Clin Pharmacol. 2023;89(12):3523-38. doi:10.1111/bcp.15846
  36. Chen CY, Chen YL, Scholl J, Yang HC, Li YCJ. MedGuard: A machine learning-based medication error detection system for improving medication safety in hospitals. Comput Methods Programs Biomed. 2024;243:107869. doi:10.1016/j.cmpb.2023.107869
  37. Abdo A, Gallay L, Vallecillo T, Clarenne J, Quillet P, Vuiblet V, et al. A machine learning-based clinical predictive tool to identify patients at high risk of medication errors. Sci Rep. 2024;14(1):32022. doi:10.1038/s41598-024-83631-w
  38. Li X, Yue X, Zhang L, Zheng X, Shang N. Pharmacist-led surgical medicines prescription optimization and prediction service improves patient outcomes—a machine learning based study. Front Pharmacol. 2025;16:1534552. doi:10.3389/fphar.2025.1534552
  39. Johns E, Guendouz A, Dal Mas L, Beck M, Alkanj A, Gourieux B, et al. Using machine learning to predict pharmaceutical interventions during medication prescription review in a hospital setting. Am J Health Syst Pharm. 2025;82(22):1238-48. doi:10.1093/ajhp/zxaf089

 

 


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.