Archive \ Volume.16 2025 Issue 3

Dividing Responsibility When a Pharmacist and an Algorithm Co-Produce the Medication Decision

, ,
  1. Department of Shared Decision-Making in Pharmacy, Faculty of Pharmacy, University of Melbourne, Melbourne, Australia.
  2. Department of Pharmacist-Algorithm Collaboration, Faculty of Pharmacy, National University of Singapore, Singapore.

Abstract

Medication decisions supported by artificial intelligence are often described as if responsibility remains wholly with the pharmacist because a human formally approves the final action. This view overlooks how data selection, model design, interface presentation, organizational configuration, professional judgment, and follow-up jointly produce the decision. This article develops a proposed Responsibility-Allocation Model for co-produced medication decisions. The model treats each decision as a responsibility-bearing episode extending across data, recommendation, approval, and follow-up. At every stage, four dimensions are examined separately: contribution, meaning the input supplied to the decision; control, meaning the feasible capacity to inspect or alter the process; authority, meaning legitimate power to approve, reject, or escalate; and liability, meaning potential legal or institutional answerability. The model maps these dimensions across the pharmacist, algorithm developer or vendor, and deploying organization. It also introduces proposed rules for non-equivalence among responsibility dimensions, effective professional control, authority–control alignment, documented disagreement, and reassessment after material change. Evaluation requires evidence of technical validity, joint human–algorithm task performance, workflow effects, medication safety, equity, traceability, organizational response, and longitudinal stability. The model does not determine negligence, allocate legal liability, establish clinical benefit, or authorize deployment. Its original contribution is a structured vocabulary and testable governance architecture for examining responsibility without reducing it either to algorithmic influence or to the pharmacist’s final click, enabling later empirical testing across pharmacy tasks and organizational contexts.


Downloads: 27
Views: 126

How to cite:
Vancouver
Zhang W, Hui C, Tan M. Dividing Responsibility When a Pharmacist and an Algorithm Co-Produce the Medication Decision. Arch Pharm Pract. 2025;16(3):46-53. https://doi.org/10.51847/bgArgCNMwK
APA
Zhang, W., Hui, C., & Tan, M. (2025). Dividing Responsibility When a Pharmacist and an Algorithm Co-Produce the Medication Decision. Archives of Pharmacy Practice, 16(3), 46-53. https://doi.org/10.51847/bgArgCNMwK

Download Citation
References
  1. Cabitza F, Rasoini R, Gensini GF. Unintended consequences of machine learning in medicine. JAMA. 2017;318(6):517-8. doi:10.1001/jama.2017.7797
  2. Sutton RT, Pincock D, Baumgart DC, Sadowski DC, Fedorak RN, Kroeker KI. An overview of clinical decision support systems: Benefits, risks, and strategies for success. npj Digit Med. 2020;3:17. doi:10.1038/s41746-020-0221-y
  3. Levivien C, Cavagna P, Grah A, Buronfosse A, Courseau R, Bézie Y, et al. Assessment of a hybrid decision support system using machine learning with artificial intelligence to safely rule out prescriptions from medication review in daily practice. Int J Clin Pharm. 2022;44(2):459-65. doi:10.1007/s11096-021-01366-4
  4. Graafsma J, Murphy RM, van de Garde EMW, Karapinar-Çarkit F, Derijks HJ, Hoge RHL, et al. The use of artificial intelligence to optimize medication alerts generated by clinical decision support systems: A scoping review. J Am Med Inform Assoc. 2024;31(6):1411-22. doi:10.1093/jamia/ocae076
  5. Vayena E, Blasimme A, Cohen IG. Machine learning in medicine: Addressing ethical challenges. PLoS Med. 2018;15(11):e1002689. doi:10.1371/journal.pmed.1002689
  6. Price WN 2nd, Gerke S, Cohen IG. Potential liability for physicians using artificial intelligence. JAMA. 2019;322(18):1765-6. doi:10.1001/jama.2019.15064
  7. Grote T, Berens P. On the ethics of algorithmic decision-making in healthcare. J Med Ethics. 2020;46(3):205-11. doi:10.1136/medethics-2019-105586
  8. Habli I, Lawton T, Porter Z. Artificial intelligence in health care: Accountability and safety. Bull World Health Organ. 2020;98(4):251-6. doi:10.2471/BLT.19.237487
  9. Topol EJ. High-performance medicine: The convergence of human and artificial intelligence. Nat Med. 2019;25(1):44-56. doi:10.1038/s41591-018-0300-7
  10. Tschandl P, Rinner C, Apalla Z, Argenziano G, Codella N, Halpern A, et al. Human-computer collaboration for skin cancer recognition. Nat Med. 2020;26(8):1229-34. doi:10.1038/s41591-020-0942-0
  11. Kiani A, Uyumazturk B, Rajpurkar P, Wang A, Gao R, Jones E, et al. Impact of a deep learning assistant on the histopathologic classification of liver cancer. npj Digit Med. 2020;3:23. doi:10.1038/s41746-020-0232-8
  12. Gaube S, Suresh H, Raue M, Merritt A, Berkowitz SJ, Lermer E, et al. Do as AI say: Susceptibility in deployment of clinical decision-aids. npj Digit Med. 2021;4:31. doi:10.1038/s41746-021-00385-9
  13. Gianfrancesco MA, Tamang S, Yazdany J, Schmajuk G. Potential biases in machine learning algorithms using electronic health record data. JAMA Intern Med. 2018;178(11):1544-7. doi:10.1001/jamainternmed.2018.3763
  14. Obermeyer Z, Powers B, Vogeli C, Mullainathan S. Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019;366(6464):447-53. doi:10.1126/science.aax2342
  15. Kompa B, Snoek J, Beam AL. Second opinion needed: Communicating uncertainty in medical machine learning. npj Digit Med. 2021;4:4. doi:10.1038/s41746-020-00367-3
  16. Kelly CJ, Karthikesalingam A, Suleyman M, Corrado G, King D. Key challenges for delivering clinical impact with artificial intelligence. BMC Med. 2019;17:195. doi:10.1186/s12916-019-1426-2
  17. Lyell D, Coiera E. Automation bias and verification complexity: A systematic review. J Am Med Inform Assoc. 2017;24(2):423-31. doi:10.1093/jamia/ocw105
  18. Nanji KC, Seger DL, Slight SP, Amato MG, Beeler PE, Her QL, et al. Medication-related clinical decision support alert overrides in inpatients. J Am Med Inform Assoc. 2018;25(5):476-81. doi:10.1093/jamia/ocx115
  19. Shah SN, Amato MG, Garlo KG, Seger DL, Bates DW. Renal medication-related clinical decision support alerts and overrides in the inpatient setting following implementation of a commercial electronic health record: Implications for designing more effective alerts. J Am Med Inform Assoc. 2021;28(6):1081-7. doi:10.1093/jamia/ocaa222
  20. Ancker JS, Edwards A, Nosal S, Hauser D, Mauer E, Kaushal R. Effects of workload, work complexity, and repeated alerts on alert fatigue in a clinical decision support system. BMC Med Inform Decis Mak. 2017;17(1):36. doi:10.1186/s12911-017-0430-8
  21. Vasey B, Nagendran M, Campbell B, Clifton DA, Collins GS, Denaxas S, et al. Reporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI. Nat Med. 2022;28(5):924-33. doi:10.1038/s41591-022-01772-9
  22. Liu X, Cruz Rivera S, Moher D, Calvert MJ, Denniston AK; SPIRIT-AI and CONSORT-AI Working Group. Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: The CONSORT-AI extension. Nat Med. 2020;26(9):1364-74. doi:10.1038/s41591-020-1034-x
  23. Cruz Rivera S, Liu X, Chan AW, Denniston AK, Calvert MJ; SPIRIT-AI and CONSORT-AI Working Group. Guidelines for clinical trial protocols for interventions involving artificial intelligence: The SPIRIT-AI extension. Nat Med. 2020;26(9):1351-63. doi:10.1038/s41591-020-1037-7
  24. Collins GS, Moons KGM, Dhiman P, Riley RD, Beam AL, Van Calster B, et al. TRIPOD+AI statement: Updated guidance for reporting clinical prediction models that use regression or machine learning methods. BMJ. 2024;385:e078378. doi:10.1136/bmj-2023-078378
  25. Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A’Court C, et al. Beyond adoption: A new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. 2017;19(11):e367. doi:10.2196/jmir.8775
  26. Wiens J, Saria S, Sendak M, Ghassemi M, Liu VX, Doshi-Velez F, et al. Do no harm: A roadmap for responsible machine learning for health care. Nat Med. 2019;25(9):1337-40. doi:10.1038/s41591-019-0548-6
  27. Carayon P, Wooldridge A, Hoonakker P, Hundt AS, Kelly MM. SEIPS 3.0: Human-centered design of the patient journey for patient safety. Appl Ergon. 2020;84:103033. doi:10.1016/j.apergo.2019.103033
  28. Reddy S, Allan S, Coghlan S, Cooper P. A governance model for the application of AI in health care. J Am Med Inform Assoc. 2020;27(3):491-7. doi:10.1093/jamia/ocz192
  29. Ghassemi M, Oakden-Rayner L, Beam AL. The false hope of current approaches to explainable artificial intelligence in health care. Lancet Digit Health. 2021;3(11):e745-e750. doi:10.1016/S2589-7500(21)00208-9
  30. Subbaswamy A, Saria S. From development to deployment: Dataset shift, causality, and shift-stable models in health AI. Biostatistics. 2020;21(2):345-52. doi:10.1093/biostatistics/kxz041
  31. Nagendran M, Chen Y, Lovejoy CA, Gordon AC, Komorowski M, Harvey H, et al. Artificial intelligence versus clinicians: Systematic review of design, reporting standards, and claims of deep learning studies. BMJ. 2020;368:m689. doi:10.1136/bmj.m689
  32. Chen IY, Pierson E, Rose S, Joshi S, Ferryman K, Ghassemi M. Ethical machine learning in healthcare. Annu Rev Biomed Data Sci. 2021;4:123-44. doi:10.1146/annurev-biodatasci-092820-114757

 

 


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.