Archive \ Volume.16 2025 Issue 4

Trust Is Not a Single Outcome in Pharmacy AI: A Realist Review of Acceptance, Reliance, and Refusal

, ,
  1. Department of Pharmacy AI and Trust Studies, Faculty of Pharmacy, Karolinska Institute, Stockholm, Sweden.
  2. Department of AI Acceptance and Pharmacy Practice, Faculty of Pharmacy, Lund University, Lund, Sweden.

Abstract

Trust is frequently treated as a desirable implementation outcome for artificial intelligence (AI) in health care. In pharmacy practice, however, acceptance, observed reliance, calibrated verification, overreliance, refusal, disengagement, and workarounds are distinct outcomes that may arise through different mechanisms and have different safety implications. To explain what forms of trust-related behaviour occur around pharmacy-relevant AI, for whom, under which technical, clinical, professional, organizational, and governance conditions, and why. A RAMESES-aligned realist review used an initial programme theory, purposive iterative searching, relevance-and-rigour selection, context-mechanism-outcome extraction, design-appropriate appraisal, contradictory-case analysis, and abductive and retroductive reasoning. The search identified 54 retrieval records. Four duplicates were removed, leaving 50 unique records: 41 evidence records and nine methodology or reporting sources. Five evidence records were excluded during title and abstract screening. Of 36 reports sought, one was not retrieved; 35 full texts were assessed, nine were excluded, and 26 reports representing 26 studies entered the realist synthesis. No quantitative synthesis was conducted.

The evidence indicated that acceptance could occur without observed reliance. Appropriate reliance appeared conditional on task fit, credible validation, uncertainty communication, training, workflow integration, and retained professional control. Incorrect or authoritative AI advice could produce overreliance, whereas safety, privacy, accountability, equity, relational, or autonomy concerns could support justified refusal. Poor integration and responsibility ambiguity could contribute to disengagement or workarounds. Increasing trust is not an adequate implementation objective. Pharmacy AI should instead be evaluated for calibrated decision use, including verification, override, escalation, refusal, and non-use. The proposed programme theory is explanatory and requires prospective validation.


Downloads: 30
Views: 118

How to cite:
Vancouver
Nilsson P, Johansson E, Andersson L. Trust Is Not a Single Outcome in Pharmacy AI: A Realist Review of Acceptance, Reliance, and Refusal. Arch Pharm Pract. 2025;16(4):43-53. https://doi.org/10.51847/rZRo3HIlbk
APA
Nilsson, P., Johansson, E., & Andersson, L. (2025). Trust Is Not a Single Outcome in Pharmacy AI: A Realist Review of Acceptance, Reliance, and Refusal. Archives of Pharmacy Practice, 16(4), 43-53. https://doi.org/10.51847/rZRo3HIlbk

Download Citation
References
  1. Starke G, Gille F, Termine A, Aquino YSJ, Chavarriaga R, Ferrario A, et al. Finding consensus on trust in AI in health care: Recommendations from a panel of international experts. J Med Internet Res. 2025;27. doi:10.2196/56306
  2. Asan O, Bayrak AE, Choudhury A. Artificial intelligence and human trust in healthcare: Focus on clinicians. J Med Internet Res. 2020;22(6). doi:10.2196/15154
  3. Tun HM, Rahman HA, Naing L, Malik OA. Trust in artificial intelligence-based clinical decision support systems among health care workers: Systematic review. J Med Internet Res. 2025;27. doi:10.2196/69678
  4. Gustafson KA, Rowe C, Gavaza P, Bernknopf AC, Nogid A, Hoffman A, et al. Pharmacists’ perceptions of artificial intelligence: A national survey. J Am Pharm Assoc (2003). 2025;65(1):102306. doi:10.1016/j.japh.2024.102306
  5. Booth A, Briscoe S, Wright JM. The “realist search”: A systematic scoping review of current practice and reporting. Res Synth Methods. 2020;11(1):14-35. doi:10.1002/jrsm.1386
  6. Hunter R, Gorely T, Beattie M, Harris K. Realist review. Int Rev Sport Exerc Psychol. 2022;15(1):242-65. doi:10.1080/1750984X.2021.1969674
  7. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ. 2021;372. doi:10.1136/bmj.n71
  8. Rethlefsen ML, Kirtley S, Waffenschmidt S, Ayala AP, Moher D, Page MJ, et al. PRISMA-S: An extension to the PRISMA statement for reporting literature searches in systematic reviews. Syst Rev. 2021;10(1):39. doi:10.1186/s13643-020-01542-z
  9. Liu X, Cruz Rivera S, Moher D, Calvert MJ, Denniston AK, Chan AW, et al. Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: The CONSORT-AI extension. Nat Med. 2020;26(9):1364-74. doi:10.1038/s41591-020-1034-x
  10. Cruz Rivera S, Liu X, Chan AW, Denniston AK, Calvert MJ, Ashrafian H, et al. Guidelines for clinical trial protocols for interventions involving artificial intelligence: The SPIRIT-AI extension. Nat Med. 2020;26(9):1351-63. doi:10.1038/s41591-020-1037-7
  11. Vasey B, Nagendran M, Campbell B, Clifton DA, Collins GS, Denaxas S, et al. Reporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI. Nat Med. 2022;28(5):924-33. doi:10.1038/s41591-022-01772-9
  12. Sounderajah V, Ashrafian H, Rose S, Shah NH, Ghassemi M, Golub R, et al. A quality assessment tool for artificial intelligence-centered diagnostic test accuracy studies: QUADAS-AI. Nat Med. 2021;27(10):1663-5. doi:10.1038/s41591-021-01517-0
  13. Collins GS, Moons KGM, Dhiman P, Riley RD, Beam AL, Van Calster B, et al. TRIPOD+AI statement: Updated guidance for reporting clinical prediction models that use regression or machine learning methods. BMJ. 2024;385. doi:10.1136/bmj-2023-078378
  14. Farah L, Davaze-Schneider J, Martin T, Nguyen P, Borget I, Martelli N. Are current clinical studies on artificial intelligence-based medical devices comprehensive enough to support a full health technology assessment? A systematic review. Artif Intell Med. 2023;140:102547. doi:10.1016/j.artmed.2023.102547
  15. Ranchon F, Chanoine S, Lambert-Lacroix S, Bosson JL, Moreau-Gaudry A, Bedouch P. Development of artificial intelligence powered apps and tools for clinical pharmacy services: A systematic review. Int J Med Inform. 2023;172:104983. doi:10.1016/j.ijmedinf.2022.104983
  16. Hatzimanolis J, Riley B, El-Den S, Aslani P, Zhou J, Chaar BB. Applications of artificial intelligence in current pharmacy practice: A scoping review. Res Social Adm Pharm. 2025;21(3):134-41. doi:10.1016/j.sapharm.2024.12.007
  17. Graafsma J, Murphy RM, van de Garde EMW, Karapinar-Carkit F, Derijks HJ, Hoge RHL, et al. The use of artificial intelligence to optimize medication alerts generated by clinical decision support systems: A scoping review. J Am Med Inform Assoc. 2024;31(6):1411-22. doi:10.1093/jamia/ocae076
  18. Dil-Nahlieli D, Ben-Yehuda A, Souroujon D, Hyam E, Shafran-Tikvah S. Validation of a novel Artificial Pharmacology Intelligence system for the management of patients with polypharmacy. Res Social Adm Pharm. 2024;20(7):633-9. doi:10.1016/j.sapharm.2024.04.003
  19. Huisman M, Ranschaert E, Parker W, Mastrodicasa D, Koci M, Pinto de Santos D, et al. An international survey on AI in radiology in 1,041 radiologists and radiology residents part 1: Fear of replacement, knowledge, and attitude. Eur Radiol. 2021;31(9):7058-66. doi:10.1007/s00330-021-07781-5
  20. Blease C, Kaptchuk TJ, Bernstein MH, Mandl KD, Halamka JD, DesRoches CM. Artificial intelligence and the future of primary care: Exploratory qualitative study of UK general practitioners’ views. J Med Internet Res. 2019;21(3). doi:10.2196/12802
  21. Gaube S, Suresh H, Raue M, Merritt A, Berkowitz SJ, Lermer E, et al. Do as AI say: Susceptibility in deployment of clinical decision-aids. NPJ Digit Med. 2021;4(1):31. doi:10.1038/s41746-021-00385-9
  22. Kiani A, Uyumazturk B, Rajpurkar P, Wang A, Gao R, Jones E, et al. Impact of a deep learning assistant on the histopathologic classification of liver cancer. NPJ Digit Med. 2020;3(1):23. doi:10.1038/s41746-020-0232-8
  23. Richardson JP, Smith C, Curtis S, Watson S, Zhu X, Barry B, et al. Patient apprehensions about the use of artificial intelligence in healthcare. NPJ Digit Med. 2021;4(1):140. doi:10.1038/s41746-021-00509-1
  24. Young AT, Amara D, Bhattacharya A, Wei ML. Patient and general public attitudes towards clinical artificial intelligence: A mixed methods systematic review. Lancet Digit Health. 2021;3(9). doi:10.1016/S2589-7500(21)00132-1
  25. Strohm L, Hehakaya C, Ranschaert ER, Boon WPC, Moors EHM. Implementation of artificial intelligence applications in radiology: Hindering and facilitating factors. Eur Radiol. 2020;30(10):5525-32. doi:10.1007/s00330-020-06946-y
  26. Tschandl P, Rinner C, Apalla Z, Argenziano G, Codella N, Halpern A, et al. Human-computer collaboration for skin cancer recognition. Nat Med. 2020;26(8):1229-34. doi:10.1038/s41591-020-0942-0
  27. Goh E, Gallo R, Hom J, Strong E, Weng Y, Kerman H, et al. Large language model influence on diagnostic reasoning: A randomized clinical trial. JAMA Netw Open. 2024;7(10). doi:10.1001/jamanetworkopen.2024.40969
  28. Markus AF, Kors JA, Rijnbeek PR. The role of explainability in creating trustworthy artificial intelligence for health care: A comprehensive survey of the terminology, design choices, and evaluation strategies. J Biomed Inform. 2021;113:103655. doi:10.1016/j.jbi.2020.103655
  29. Obermeyer Z, Powers B, Vogeli C, Mullainathan S. Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019;366(6464):447-53. doi:10.1126/science.aax2342
  30. Khera R, Simon MA, Ross JS. Automation bias and assistive AI: Risk of harm from AI-driven clinical decision support. JAMA. 2023;330(23):2255-7. doi:10.1001/jama.2023.22557
  31. Rajkomar A, Hardt M, Howell MD, Corrado G, Chin MH. Ensuring fairness in machine learning to advance health equity. Ann Intern Med. 2018;169(12):866-72. doi:10.7326/M18-1990
  32. Ghassemi M, Oakden-Rayner L, Beam AL. The false hope of current approaches to explainable artificial intelligence in health care. Lancet Digit Health. 2021;3(11). doi:10.1016/S2589-7500(21)00208-9
  33. Amann J, Blasimme A, Vayena E, Frey D, Madai VI; Precise4Q Consortium. Explainability for artificial intelligence in healthcare: A multidisciplinary perspective. BMC Med Inform Decis Mak. 2020;20(1):310. doi:10.1186/s12911-020-01332-6
  34. Morley J, Machado CCV, Burr C, Cowls J, Joshi I, Taddeo M, et al. The ethics of AI in health care: A mapping review. Soc Sci Med. 2020;260:113172. doi:10.1016/j.socscimed.2020.113172

 

 


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.