Archive \ Volume.16 2025 Issue 3

Translating Algorithmic Uncertainty into Actionable Medication Advice

, ,
  1. Department of Clinical Pharmacy and Uncertainty Communication, Faculty of Pharmacy, Cairo University, Cairo, Egypt.
  2. Department of AI Actionability and Medication Advice, Faculty of Pharmacy, Alexandria University, Alexandria, Egypt.

Abstract

Artificial intelligence can attach probabilities, confidence scores, intervals, disagreement measures, or out-of-distribution signals to medication-related outputs, yet these numerical representations do not independently specify what a pharmacist, prescriber, or patient should do. The problem is not only whether uncertainty is estimated, but whether its source, decision relevance, consequences, and ownership are translated into a proportionate response. This article develops a proposed Uncertainty-Translation Framework for actionable medication advice. The framework separates algorithmic output from medication decision-making through five connected functions: uncertainty characterization; calibration, coverage, data-completeness, and scope checks; interpretation of the affected medication decision; selection of a bounded action class; and recipient-specific communication supported by an auditable governance record. Proposed action classes include proceeding with qualified advice, verifying data, checking an independent source, delaying action, communicating uncertainty, or escalating to an accountable professional. The framework treats these classes as conditional design hypotheses rather than clinical rules. Validation would require technical assessment of calibration and coverage; human-factors testing of comprehension, workload, and inappropriate reliance; evaluation of medication decisions and downstream consequences; subgroup and equity analyses; and prospective governance of versioning, overrides, incidents, and withdrawal. The framework cannot correct biased targets, invalid data, unsuitable model purposes, or deficient professional judgment. Its original contribution is to define uncertainty translation as an intermediate sociotechnical function between prediction and advice while preserving the boundaries between technical performance, clinical usefulness, professional authority, and validated benefit.


Downloads: 20
Views: 92

How to cite:
Vancouver
Zayed O, Ibrahim L, Mansour A. Translating Algorithmic Uncertainty into Actionable Medication Advice. Arch Pharm Pract. 2025;16(3):63-70. https://doi.org/10.51847/A5cYIK22eM
APA
Zayed, O., Ibrahim, L., & Mansour, A. (2025). Translating Algorithmic Uncertainty into Actionable Medication Advice. Archives of Pharmacy Practice, 16(3), 63-70. https://doi.org/10.51847/A5cYIK22eM

Download Citation
References
  1. Kelly CJ, Karthikesalingam A, Suleyman M, Corrado G, King D. Key challenges for delivering clinical impact with artificial intelligence. BMC Med. 2019;17(1):195. doi:10.1186/s12916-019-1426-2
  2. Ghassemi M, Oakden-Rayner L, Beam AL. The false hope of current approaches to explainable artificial intelligence in health care. Lancet Digit Health. 2021;3(11). doi:10.1016/S2589-7500(21)00208-9
  3. Sutton RT, Pincock D, Baumgart DC, Sadowski DC, Fedorak RN, Kroeker KI. An overview of clinical decision support systems: Benefits, risks, and strategies for success. NPJ Digit Med. 2020;3(1):17. doi:10.1038/s41746-020-0221-y
  4. Wiens J, Saria S, Sendak M, Ghassemi M, Liu VX, Doshi-Velez F, et al. Do no harm: A roadmap for responsible machine learning for health care. Nat Med. 2019;25(9):1337-40. doi:10.1038/s41591-019-0548-6
  5. Hüllermeier E, Waegeman W. Aleatoric and epistemic uncertainty in machine learning: An introduction to concepts and methods. Mach Learn. 2021;110(3):457-506. doi:10.1007/s10994-021-05946-3
  6. Begoli E, Bhattacharya T, Kusnezov D. The need for uncertainty quantification in machine-assisted medical decision making. Nat Mach Intell. 2019;1(1):20-23. doi:10.1038/s42256-018-0004-1
  7. Abdar M, Pourpanah F, Hussain S, Rezazadegan D, Liu L, Ghavamzadeh M, et al. A review of uncertainty quantification in deep learning: Techniques, applications and challenges. Inf Fusion. 2021;76:243-97. doi:10.1016/j.inffus.2021.05.008
  8. Goetz L, Seedat N, Vandersluis R, van der Schaar M. Generalization—a key challenge for responsible AI in patient-facing clinical applications. NPJ Digit Med. 2024;7(1):126. doi:10.1038/s41746-024-01127-3
  9. Van Calster B, McLernon DJ, van Smeden M, Wynants L, Steyerberg EW; Topic Group ‘Evaluating diagnostic tests and prediction models’ of the STRATOS initiative. Calibration: The Achilles heel of predictive analytics. BMC Med. 2019;17(1):230. doi:10.1186/s12916-019-1466-7
  10. Kompa B, Snoek J, Beam AL. Second opinion needed: Communicating uncertainty in medical machine learning. NPJ Digit Med. 2021;4(1):4. doi:10.1038/s41746-020-00367-3
  11. Sendak MP, Gao M, Brajer N, Balu S. Presenting machine learning model information to clinical end users with model facts labels. NPJ Digit Med. 2020;3(1):41. doi:10.1038/s41746-020-0253-3
  12. Amann J, Blasimme A, Vayena E, Frey D, Madai VI; Precise4Q consortium. Explainability for artificial intelligence in healthcare: A multidisciplinary perspective. BMC Med Inform Decis Mak. 2020;20(1):310. doi:10.1186/s12911-020-01332-6
  13. Shashikumar SP, Wardi G, Malhotra A, Nemati S. Artificial intelligence sepsis prediction algorithm learns to say “I don’t know”. NPJ Digit Med. 2021;4(1):134. doi:10.1038/s41746-021-00504-6
  14. Ancker JS, Edwards A, Nosal S, Hauser D, Mauer E, Kaushal R; HITEC Investigators. Effects of workload, work complexity, and repeated alerts on alert fatigue in a clinical decision support system. BMC Med Inform Decis Mak. 2017;17(1):36. doi:10.1186/s12911-017-0430-8
  15. Graafsma J, Murphy RM, van de Garde EMW, Karapinar-Çarkit F, Derijks HJ, Hoge RHL, et al. The use of artificial intelligence to optimize medication alerts generated by clinical decision support systems: A scoping review. J Am Med Inform Assoc. 2024;31(6):1411-22. doi:10.1093/jamia/ocae076
  16. Holbrook AM, Matos Silva J, Faruque JAY, Deng J, Schneider T, Jaffer A. Effect of electronic drug-drug interaction alerts on patient and clinician outcomes: A systematic review. J Am Med Inform Assoc. 2025;32(10):1617-28. doi:10.1093/jamia/ocaf139
  17. Staes CJ, Beck AC, Chalkidis G, Scheese CH, Taft T, Guo JW, et al. Design of an interface to communicate artificial intelligence-based prognosis for patients with advanced solid tumors: A user-centered approach. J Am Med Inform Assoc. 2024;31(1):174-87. doi:10.1093/jamia/ocad201
  18. Longoni C, Bonezzi A, Morewedge CK. Resistance to medical artificial intelligence. J Consum Res. 2019;46(4):629-50. doi:10.1093/jcr/ucz013
  19. Ongena YP, Haan M, Yakar D, Kwee TC. Patients’ views on the implementation of artificial intelligence in radiology: Development and validation of a standardized questionnaire. Eur Radiol. 2020;30(2):1033-40. doi:10.1007/s00330-019-06486-0
  20. Blease C, Kaptchuk TJ, Bernstein MH, Mandl KD, Halamka JD, DesRoches CM. Artificial intelligence and the future of primary care: Exploratory qualitative study of UK general practitioners’ views. J Med Internet Res. 2019;21(3). doi:10.2196/12802
  21. Tschandl P, Rinner C, Apalla Z, Argenziano G, Codella N, Halpern A, et al. Human-computer collaboration for skin cancer recognition. Nat Med. 2020;26(8):1229-34. doi:10.1038/s41591-020-0942-0
  22. Gaube S, Suresh H, Raue M, Merritt A, Berkowitz SJ, Lermer E, et al. Do as AI say: Susceptibility in deployment of clinical decision-aids. NPJ Digit Med. 2021;4(1):31. doi:10.1038/s41746-021-00385-9
  23. Nagendran M, Festor P, Komorowski M, Gordon AC, Faisal AA. Eye tracking insights into physician behaviour with safe and unsafe explainable AI recommendations. NPJ Digit Med. 2024;7(1):202. doi:10.1038/s41746-024-01200-x
  24. Susanto AP, Lyell D, Widyantoro B, Berkovsky S, Magrabi F. Effects of machine learning-based clinical decision support systems on decision-making, care delivery, and patient outcomes: A scoping review. J Am Med Inform Assoc. 2023;30(12):2050-63. doi:10.1093/jamia/ocad180
  25. Vasey B, Nagendran M, Campbell B, Clifton DA, Collins GS, Denaxas S, et al. Reporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI. Nat Med. 2022;28(5):924-33. doi:10.1038/s41591-022-01772-9
  26. Liu X, Cruz Rivera S, Moher D, Calvert MJ, Denniston AK, Chan AW, et al. Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: The CONSORT-AI extension. Nat Med. 2020;26(9):1364-74. doi:10.1038/s41591-020-1034-x
  27. Cruz Rivera S, Liu X, Chan AW, Denniston AK, Calvert MJ; SPIRIT-AI and CONSORT-AI Working Group. Guidelines for clinical trial protocols for interventions involving artificial intelligence: The SPIRIT-AI extension. Nat Med. 2020;26(9):1351-63. doi:10.1038/s41591-020-1037-7
  28. Reddy S, Allan S, Coghlan S, Cooper P. A governance model for the application of AI in health care. J Am Med Inform Assoc. 2020;27(3):491-7. doi:10.1093/jamia/ocz192
  29. Obermeyer Z, Powers B, Vogeli C, Mullainathan S. Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019;366(6464):447-53. doi:10.1126/science.aax2342
  30. Seyyed-Kalantari L, Zhang H, McDermott MBA, Chen IY, Ghassemi M. Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations. Nat Med. 2021;27(12):2176-82. doi:10.1038/s41591-021-01595-0
  31. Varoquaux G, Cheplygina V. Machine learning for medical imaging: Methodological failures and recommendations for the future. NPJ Digit Med. 2022;5(1):48. doi:10.1038/s41746-022-00592-y

 

 


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.