Archive \ Volume.17 2026 Issue 3

When Does Human–AI Collaboration Improve Clinical Pharmacy? A Realist Review of Trust, Workload, and Decision Quality

, , ,
  1. Department of Human-AI Collaboration in Pharmacy, Faculty of Pharmacy, University of Dundee, Dundee, United Kingdom.
  2. Department of Trust and Workload in Clinical Pharmacy, Faculty of Pharmacy, Newcastle University, Newcastle, United Kingdom.
  3. Department of Decision Quality and AI Partnership, Faculty of Pharmacy, University of Aberdeen, Aberdeen, United Kingdom.

Abstract

Human–AI collaboration in clinical pharmacy is often evaluated through average accuracy or efficiency, although the same system may reduce cognitive burden in one setting while increasing interruption, misplaced trust, or responsibility ambiguity in another. This realist review examined when, how, for whom, and under what conditions human–AI collaboration may improve medication-related decision quality, workload, and safety. We used a RAMESES-aligned realist-review design. Searches covered seven databases and supplementary citation, journal, web, and registry sources. After deduplication, 817 records were screened, 79 reports were sought, 76 full texts were assessed, and 21 reports representing 21 distinct study or document families were included. Evidence was selected for relevance and rigour, extracted into context–mechanism–outcome configurations, tested against contradictory cases, and synthesized into a refined programme theory. Collaboration appeared most promising when AI supplied complementary, task-specific information; pharmacists retained interpretive authority; outputs were integrated into workflow; and escalation routes remained explicit. Workload reduction could preserve cognitive capacity when low-value processing was removed, but poorly targeted alerts redistributed rather than reduced work. Trust was more appropriately calibrated when system limits, uncertainty, and accountability were visible. Incorrect recommendations, opaque explanations, weak organizational support, and unclear responsibility could promote automation bias, vigilance loss, or decision diffusion. workflow, professional authority, organizational support, and system reliability. The resulting programme theory is evidence-bounded and requires prospective testing in clinical-pharmacy settings before routine implementation.


Downloads: 21
Views: 68

How to cite:
Vancouver
Wilson G, Bennett C, Wright E, Turner J. When Does Human–AI Collaboration Improve Clinical Pharmacy? A Realist Review of Trust, Workload, and Decision Quality. Arch Pharm Pract. 2026;17(3):66-74. https://doi.org/10.51847/hvKJBM7bs8
APA
Wilson, G., Bennett, C., Wright, E., & Turner, J. (2026). When Does Human–AI Collaboration Improve Clinical Pharmacy? A Realist Review of Trust, Workload, and Decision Quality. Archives of Pharmacy Practice, 17(3), 66-74. https://doi.org/10.51847/hvKJBM7bs8

Download Citation
References
  1. Topol EJ. High-performance medicine: The convergence of human and artificial intelligence. Nat Med. 2019;25(1):44-56. doi:10.1038/s41591-018-0300-7
  2. Tschandl P, Rinner C, Apalla Z, Argenziano G, Codella N, Halpern A, et al. Human-computer collaboration for skin cancer recognition. Nat Med. 2020;26(8):1229-34. doi:10.1038/s41591-020-0942-0
  3. Kiani A, Uyumazturk B, Rajpurkar P, Wang A, Gao R, Jones E, et al. Impact of a deep learning assistant on the histopathologic classification of liver cancer. NPJ Digit Med. 2020;3(1):23. doi:10.1038/s41746-020-0232-8
  4. Wang G, Zhang K, Jiang J, Wang C, Bi H, Liang H, et al. Human-large language model collaboration in clinical medicine: A systematic review and meta-analysis. NPJ Digit Med. 2026;9(1):195. doi:10.1038/s41746-026-02382-2
  5. Jagosh J. Realist synthesis for public health: Building an ontologically deep understanding of how programs work, for whom, and in which contexts. Annu Rev Public Health. 2019;40:361-72. doi:10.1146/annurev-publhealth-031816-044451
  6. Dada S, Dalkin S, Gilmore B, Hunter R, Mukumbang FC. Applying and reporting relevance, richness and rigour in realist evidence appraisals: Advancing key concepts in realist reviews. Res Synth Methods. 2023;14(3):504-14. doi:10.1002/jrsm.1630
  7. Renmans D, Castellano Pleguezuelo V. Methods in realist evaluation: A mapping review. Eval Program Plann. 2023;97:102209. doi:10.1016/j.evalprogplan.2022.102209
  8. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. doi:10.1136/bmj.n71
  9. Page MJ, Moher D, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. PRISMA 2020 explanation and elaboration: Updated guidance and exemplars for reporting systematic reviews. BMJ. 2021;372:n160. doi:10.1136/bmj.n160
  10. Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): Checklist and explanation. Ann Intern Med. 2018;169(7):467-73. doi:10.7326/M18-0850
  11. van de Schoot R, de Bruin J, Schram R, Zahedi P, de Boer J, Weijdema F, et al. An open source machine learning framework for efficient and transparent systematic reviews. Nat Mach Intell. 2021;3(2):125-33. doi:10.1038/s42256-020-00287-7
  12. Gusenbauer M, Haddaway NR. Which academic search systems are suitable for systematic reviews or meta-analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resources. Res Synth Methods. 2020;11(2):181-217. doi:10.1002/jrsm.1378
  13. Muka T, Glisic M, Milic J, Verhoog S, Bohlius J, Bramer W, et al. A 24-step guide on how to design, conduct, and successfully publish a systematic review and meta-analysis in medical research. Eur J Epidemiol. 2020;35(1):49-60. doi:10.1007/s10654-019-00576-5
  14. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. Updating guidance for reporting systematic reviews: Development of the PRISMA 2020 statement. J Clin Epidemiol. 2021;134:103-12. doi:10.1016/j.jclinepi.2021.02.003
  15. Nagendran M, Chen Y, Lovejoy CA, Gordon AC, Komorowski M, Harvey H, et al. Artificial intelligence versus clinicians: Systematic review of design, reporting standards, and claims of deep learning studies. BMJ. 2020;368:m689. doi:10.1136/bmj.m689
  16. Graafsma J, Murphy RM, van de Garde EMW, Karapinar-Çarkit F, Derijks HJ, Hoge RHL, et al. The use of artificial intelligence to optimize medication alerts generated by clinical decision support systems: A scoping review. J Am Med Inform Assoc. 2024;31(6):1411-22. doi:10.1093/jamia/ocae076
  17. Tun HM, Rahman HA, Naing L, Malik OA. Trust in artificial intelligence-based clinical decision support systems among health care workers: Systematic review. J Med Internet Res. 2025;27:e69678. doi:10.2196/69678
  18. Jackson NJ, Brown KE, Miller R, Murrow M, Cauley MR, Collins BX, et al. Factors influencing the effectiveness of artificial intelligence-assisted decision-making in medicine: A scoping review. J Am Med Inform Assoc. 2026;33(5):1054-64. doi:10.1093/jamia/ocag002
  19. Marcilly R, Colliaux J, Robert L, Pelayo S, Beuscart JB, Rousselière C, et al. Improving the usability and usefulness of computerized decision support systems for medication review by clinical pharmacists: A convergent, parallel evaluation. Res Social Adm Pharm. 2023;19(1):144-54. doi:10.1016/j.sapharm.2022.08.012
  20. Goh E, Gallo R, Hom J, Strong E, Weng Y, Kerman H, et al. Large language model influence on diagnostic reasoning: A randomized clinical trial. JAMA Netw Open. 2024;7(10):e2440969. doi:10.1001/jamanetworkopen.2024.40969
  21. Bolton WJ, Wilson R, Gilchrist M, Georgiou P, Holmes A, Rawson TM. The impact of artificial intelligence-driven decision support on uncertain antimicrobial prescribing: A randomised, multimethod study. Lancet Digit Health. 2025;7(11):100912. doi:10.1016/j.landig.2025.100912
  22. Ancker JS, Edwards A, Nosal S, Hauser D, Mauer E, Kaushal R; HITEC Investigators. Effects of workload, work complexity, and repeated alerts on alert fatigue in a clinical decision support system. BMC Med Inform Decis Mak. 2017;17(1):36. doi:10.1186/s12911-017-0430-8
  23. Hussain MI, Reynolds TL, Zheng K. Medication safety alert fatigue may be reduced via interaction design and clinical role tailoring: A systematic review. J Am Med Inform Assoc. 2019;26(10):1141-9. doi:10.1093/jamia/ocz095
  24. Chen CY, Chen YL, Scholl J, Yang HC, Li YCJ. Ability of machine-learning based clinical decision support system to reduce alert fatigue, wrong-drug errors, and alert users about look alike, sound alike medication. Comput Methods Programs Biomed. 2024;243:107869. doi:10.1016/j.cmpb.2023.107869
  25. Gaube S, Suresh H, Raue M, Merritt A, Berkowitz SJ, Lermer E, et al. Do as AI say: Susceptibility in deployment of clinical decision-aids. NPJ Digit Med. 2021;4(1):31. doi:10.1038/s41746-021-00385-9
  26. Kücking F, Busch DA, Przysucha M, Kutza JO, Hannemann N, Hüsers J, et al. Impact of AI recommendation correctness on diagnostic accuracy in clinical decision-making. Int J Med Inform. 2026;207:106223. doi:10.1016/j.ijmedinf.2025.106223
  27. Rezaeian O, Asan O, Bayrak AE. The impact of AI explanations on clinicians’ trust and diagnostic accuracy in breast cancer. Appl Ergon. 2025;129:104577. doi:10.1016/j.apergo.2025.104577
  28. Jones C, Thornton J, Wyatt JC. Artificial intelligence and clinical decision support: Clinicians’ perspectives on trust, trustworthiness, and liability. Med Law Rev. 2023;31(4):501-20. doi:10.1093/medlaw/fwad013
  29. Kashyap S, Morse KE, Patel B, Shah NH. A survey of extant organizational and computational setups for deploying predictive models in health systems. J Am Med Inform Assoc. 2021;28(11):2445-50. doi:10.1093/jamia/ocab154
  30. Sutton RT, Pincock D, Baumgart DC, Sadowski DC, Fedorak RN, Kroeker KI. An overview of clinical decision support systems: Benefits, risks, and strategies for success. NPJ Digit Med. 2020;3(1):17. doi:10.1038/s41746-020-0221-y
  31. Wiens J, Saria S, Sendak M, Ghassemi M, Liu VX, Doshi-Velez F, et al. Do no harm: A roadmap for responsible machine learning for health care. Nat Med. 2019;25(9):1337-40. doi:10.1038/s41591-019-0548-6
  32. Ghassemi M, Oakden-Rayner L, Beam AL. The false hope of current approaches to explainable artificial intelligence in health care. Lancet Digit Health. 2021;3(11):e745-50. doi:10.1016/S2589-7500(21)00208-9
  33. Goh E, Gallo RJ, Strong E, Weng Y, Kerman H, Freed JA, et al. GPT-4 assistance for improvement of physician performance on patient care tasks: A randomized controlled trial. Nat Med. 2025;31(4):1233-8. doi:10.1038/s41591-024-03456-y
  34. Vasey B, Nagendran M, Campbell B, Clifton DA, Collins GS, Denaxas S, et al. Reporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI. Nat Med. 2022;28(5):924-33. doi:10.1038/s41591-022-01772-9
  35. Liu X, Cruz Rivera S, Moher D, Calvert MJ, Denniston AK; SPIRIT-AI and CONSORT-AI Working Group. Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: The CONSORT-AI extension. Nat Med. 2020;26(9):1364-74. doi:10.1038/s41591-020-1034-x
  36. Cruz Rivera S, Liu X, Chan AW, Denniston AK, Calvert MJ; SPIRIT-AI and CONSORT-AI Working Group; SPIRIT-AI and CONSORT-AI Steering Group; SPIRIT-AI and CONSORT-AI Consensus Group. Guidelines for clinical trial protocols for interventions involving artificial intelligence: The SPIRIT-AI extension. Nat Med. 2020;26(9):1351-63. doi:10.1038/s41591-020-1037-7

 

 


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.