Archive \ Volume.17 2026 Issue 1

Multimodal Pharmacy Intelligence for Linking Prescriptions, Symptoms, Laboratory Trends, Images, and

, , ,
  1. Department of Multimodal AI in Pharmacy, Faculty of Pharmacy, University of Buenos Aires, Buenos Aires, Argentina.
  2. Department of Cross-Modal Pharmacy Data Integration, Faculty of Pharmacy, Pontifical Catholic University of Chile, Santiago, Chile.
  3. Department of Multisensory Pharmacy Intelligence, Faculty of Pharmacy, National University of La Plata, La Plata, Argentina.

Abstract

Medication decisions are rarely supported by prescriptions alone. Pharmacists may need to relate medication orders to reported symptoms, longitudinal laboratory changes, clinical images, spoken information, documentation context, and prior therapeutic events. These information forms differ in structure, reliability, timing, provenance, and clinical meaning, creating a problem that cannot be resolved through simple data concatenation or a single predictive model. This article proposes a Multimodal Pharmacy Intelligence Architecture for organizing heterogeneous patient information while preserving uncertainty and professional decision authority. The architecture contains source and identity controls, modality-specific ingestion and representation, provenance and data-quality assessment, temporal normalization, cross-modal alignment, task-specific fusion, uncertainty management, and a pharmacist-facing evidence bundle. A proposed Pharmacy Alignment Graph represents relationships among observations without treating temporal proximity as causality. Missing, stale, conflicting, or low-quality modalities remain visible rather than being silently imputed or suppressed. A Pharmacist Decision Boundary separates computational transformation from medication verification, interpretation, communication, escalation, and action. Evaluation is organized across representation integrity, alignment accuracy, missing-modality robustness, task performance, human–AI interaction, workflow consequences, medication safety, equity, and local transportability. The architecture is an original non-empirical synthesis rather than a validated clinical system. Its usefulness is conditional on task-specific evidence, semantic interoperability, prospective human-factors assessment, subgroup evaluation, incident monitoring, and governed change control. Multimodal agreement does not establish clinical truth, and model output does not independently authorize medication decisions. The proposed contribution offers a structured basis for developing and evaluating traceable multimodal decision support in pharmacy practice.


Downloads: 30
Views: 70

How to cite:
Vancouver
Morales S, Rojas L, Vega C, Molina D. Multimodal Pharmacy Intelligence for Linking Prescriptions, Symptoms, Laboratory Trends, Images, and. Arch Pharm Pract. 2026;17(1):13-21. https://doi.org/10.51847/SFkaknFouO
APA
Morales, S., Rojas, L., Vega, C., & Molina, D. (2026). Multimodal Pharmacy Intelligence for Linking Prescriptions, Symptoms, Laboratory Trends, Images, and. Archives of Pharmacy Practice, 17(1), 13-21. https://doi.org/10.51847/SFkaknFouO

Download Citation
References
  1. Acosta JN, Falcone GJ, Rajpurkar P, Topol EJ. Multimodal biomedical AI. Nat Med. 2022;28(9):1773-84. doi:10.1038/s41591-022-01981-2
  2. Xiao C, Choi E, Sun J. Opportunities and challenges in developing deep learning models using electronic health records data: A systematic review. J Am Med Inform Assoc. 2018;25(10):1419-28. doi:10.1093/jamia/ocy068
  3. Dickinson H, Teltsch DY, Feifel J, Hunt P, Vallejo-Yagüe E, Virkud AV, et al. The unseen hand: AI-based prescribing decision support tools and the evaluation of drug safety and effectiveness. Drug Saf. 2024;47(2):117-23. doi:10.1007/s40264-023-01376-3
  4. Corny J, Rajkumar A, Martin O, Dode X, Lajonchère JP, Billuart O, et al. A machine learning-based clinical decision support system to identify prescriptions with a high risk of medication error. J Am Med Inform Assoc. 2020;27(11):1688-94. doi:10.1093/jamia/ocaa154
  5. Graafsma J, Murphy RM, van de Garde EMW, Karapinar-Çarkit F, Derijks HJ, Hoge RHL, et al. The use of artificial intelligence to optimize medication alerts generated by clinical decision support systems: A scoping review. J Am Med Inform Assoc. 2024;31(6):1411-22. doi:10.1093/jamia/ocae076
  6. Rajkomar A, Oren E, Chen K, Dai AM, Hajaj N, Hardt M, et al. Scalable and accurate deep learning with electronic health records. NPJ Digit Med. 2018;1:18. doi:10.1038/s41746-018-0029-1
  7. Harutyunyan H, Khachatrian H, Kale DC, Ver Steeg G, Galstyan A. Multitask learning and benchmarking with clinical time series data. Sci Data. 2019;6:96. doi:10.1038/s41597-019-0103-9
  8. Kiyoshige E, Ogata S, Kwon N, Nakaoku Y, Hayashi C, Blaylock N, et al. Developing and testing AI-based voice biomarker models to detect cognitive impairment among community dwelling adults: A cross-sectional study in Japan. Lancet Reg Health West Pac. 2025;59:101598. doi:10.1016/j.lanwpc.2025.101598
  9. Huang SC, Pareek A, Seyyedi S, Banerjee I, Lungren MP. Fusion of medical imaging and electronic health records using deep learning: A systematic review and implementation guidelines. NPJ Digit Med. 2020;3:136. doi:10.1038/s41746-020-00341-z
  10. Lehne M, Sass J, Essenwanger A, Schepers J, Thun S. Why digital medicine depends on interoperability. NPJ Digit Med. 2019;2:79. doi:10.1038/s41746-019-0158-1
  11. Baltrušaitis T, Ahuja C, Morency LP. Multimodal machine learning: A survey and taxonomy. IEEE Trans Pattern Anal Mach Intell. 2019;41(2):423-43. doi:10.1109/TPAMI.2018.2798607
  12. Krones F, Marikkar U, Parsons G, Szmul A, Mahdi A. Review of multimodal machine learning approaches in healthcare. Inf Fusion. 2025;114:102690. doi:10.1016/j.inffus.2024.102690
  13. Chen RJ, Lu MY, Wang J, Williamson DFK, Rodig SJ, Lindeman NI, et al. Pathomic Fusion: An integrated framework for fusing histopathology and genomic features for cancer diagnosis and prognosis. IEEE Trans Med Imaging. 2022;41(4):757-70. doi:10.1109/TMI.2020.3021387
  14. Moor M, Banerjee O, Abad ZSH, Krumholz HM, Leskovec J, Topol EJ, et al. Foundation models for generalist medical artificial intelligence. Nature. 2023;616(7956):259-65. doi:10.1038/s41586-023-05881-4
  15. Liu J, Capurro D, Nguyen A, Verspoor K. Attention-based multimodal fusion with contrast for robust clinical prediction in the face of missing modalities. J Biomed Inform. 2023;145:104466. doi:10.1016/j.jbi.2023.104466
  16. Lim B, Arık SÖ, Loeff N, Pfister T. Temporal Fusion Transformers for interpretable multi-horizon time series forecasting. Int J Forecast. 2021;37(4):1748-64. doi:10.1016/j.ijforecast.2021.03.012
  17. Tomašev N, Glorot X, Rae JW, Zielinski M, Askham H, Saraiva A, et al. A clinically applicable approach to continuous prediction of future acute kidney injury. Nature. 2019;572(7767):116-9. doi:10.1038/s41586-019-1390-1
  18. Shang N, Weng C, Hripcsak G. A conceptual framework for evaluating data suitability for observational studies. J Am Med Inform Assoc. 2018;25(3):248-58. doi:10.1093/jamia/ocx095
  19. Che Z, Purushotham S, Cho K, Sontag D, Liu Y. Recurrent neural networks for multivariate time series with missing values. Sci Rep. 2018;8:6085. doi:10.1038/s41598-018-24271-9
  20. Badgeley MA, Zech JR, Oakden-Rayner L, Glicksberg BS, Liu M, Gale W, et al. Deep learning predicts hip fracture using confounding patient and healthcare variables. NPJ Digit Med. 2019;2:31. doi:10.1038/s41746-019-0105-1
  21. Roberts M, Driggs D, Thorpe M, Gilbey J, Yeung M, Ursprung S, et al. Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scans. Nat Mach Intell. 2021;3(3):199-217. doi:10.1038/s42256-021-00307-0
  22. Finlayson SG, Bowers JD, Ito J, Zittrain JL, Beam AL, Kohane IS. Adversarial attacks on medical machine learning. Science. 2019;363(6433):1287-9. doi:10.1126/science.aaw4399
  23. Wiens J, Saria S, Sendak M, Ghassemi M, Liu VX, Doshi-Velez F, et al. Do no harm: A roadmap for responsible machine learning for health care. Nat Med. 2019;25(9):1337-40. doi:10.1038/s41591-019-0548-6
  24. Collins GS, Moons KGM, Dhiman P, Riley RD, Beam AL, Van Calster B, et al. TRIPOD+AI statement: Updated guidance for reporting clinical prediction models that use regression or machine learning methods. BMJ. 2024;385. doi:10.1136/bmj-2023-078378
  25. Liu X, Cruz Rivera S, Moher D, Calvert MJ, Denniston AK, SPIRIT-AI and CONSORT-AI Working Group. Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: The CONSORT-AI extension. Nat Med. 2020;26(9):1364-74. doi:10.1038/s41591-020-1034-x
  26. Vasey B, Nagendran M, Campbell B, Clifton DA, Collins GS, Denaxas S, et al. Reporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI. Nat Med. 2022;28(5):924-33. doi:10.1038/s41591-022-01772-9
  27. Sutton RT, Pincock D, Baumgart DC, Sadowski DC, Fedorak RN, Kroeker KI. An overview of clinical decision support systems: Benefits, risks, and strategies for success. NPJ Digit Med. 2020;3:17. doi:10.1038/s41746-020-0221-y
  28. Farič N, Hinder S, Williams R, Ramaesh R, Bernabeu MO, van Beek E, et al. Early experiences of integrating an artificial intelligence-based diagnostic decision support system into radiology settings: A qualitative study. J Am Med Inform Assoc. 2024;31(1):24-34. doi:10.1093/jamia/ocad191
  29. Tschandl P, Rinner C, Apalla Z, Argenziano G, Codella N, Halpern A, et al. Human-computer collaboration for skin cancer recognition. Nat Med. 2020;26(8):1229-34. doi:10.1038/s41591-020-0942-0
  30. Labkoff S, Oladimeji B, Kannry J, Solomonides A, Leftwich R, Koski E, et al. Toward a responsible future: Recommendations for AI-enabled clinical decision support. J Am Med Inform Assoc. 2024;31(11):2730-9. doi:10.1093/jamia/ocae209
  31. Ghassemi M, Oakden-Rayner L, Beam AL. The false hope of current approaches to explainable artificial intelligence in health care. Lancet Digit Health. 2021;3(11). doi:10.1016/S2589-7500(21)00208-9
  32. Obermeyer Z, Powers B, Vogeli C, Mullainathan S. Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019;366(6464):447-53. doi:10.1126/science.aax2342
  33. Seyyed-Kalantari L, Zhang H, McDermott MBA, Chen IY, Ghassemi M. Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations. Nat Med. 2021;27(12):2176-82. doi:10.1038/s41591-021-01595-0
  34. Futoma J, Simons M, Panch T, Doshi-Velez F, Celi LA. The myth of generalisability in clinical research and machine learning in health care. Lancet Digit Health. 2020;2(9). doi:10.1016/S2589-7500(20)30186-2

 

 


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.