Archive \ Volume.17 2026 Issue 2

Detecting Workflow Drift before Pharmacy Algorithms Learn the Wrong Practice

, , ,
  1. Department of Workflow Drift Detection in Pharmacy, Faculty of Pharmacy, University of Lille, Lille, France.
  2. Department of AI Practice Integrity, Faculty of Pharmacy, University of Montpellier, Montpellier, France.
  3. Department of Algorithm Monitoring and Correction, Faculty of Pharmacy, University of Nantes, Nantes, France.

Abstract

Artificial intelligence increasingly participates in medication-related prioritization, alerting, verification, documentation, and clinical decision support. Yet deployed algorithms may continue learning while the pharmacy work that produces their inputs, labels, feedback, and outcomes is changing. This creates a risk that temporary workarounds, redistributed responsibilities, altered documentation, changing patient populations, or unsafe local practices become represented as legitimate practice. This article defines pharmacy workflow drift as a material temporal change in the tasks, professional roles, activity sequence, patient or case population, or documentation processes through which medication-related work is performed and represented. It proposes a Multidimensional Pharmacy Workflow-Drift Framework comprising a baseline workflow contract, five-dimensional observability layer, cross-dimensional coupling assessment, consequence layer, and learning-control layer. Detection is separated from diagnosis: a statistical or process signal initiates investigation but does not confirm drift, establish causation, or authorize model updating. The framework therefore connects drift localization to medication-safety, equity, human-factors, implementation, and accountability assessments before selecting a learning state such as continued operation, enhanced surveillance, learning freeze, restricted use, controlled updating, rollback, or retirement. Validation would require technical sensitivity, false-alarm assessment, causal plausibility, workflow localization, professional usability, subgroup stability, safety evaluation, rollback capability, and recurring local requalification. The framework is an original non-empirical governance synthesis. It does not provide validated thresholds, guarantee safer decisions, allocate legal liability, or establish regulatory or deployment readiness.


Downloads: 26
Views: 97

How to cite:
Vancouver
Dupuis C, Perrin H, Morel E, Martin T. Detecting Workflow Drift before Pharmacy Algorithms Learn the Wrong Practice. Arch Pharm Pract. 2026;17(2):21-9. https://doi.org/10.51847/78i64L2M3E
APA
Dupuis, C., Perrin, H., Morel, E., & Martin, T. (2026). Detecting Workflow Drift before Pharmacy Algorithms Learn the Wrong Practice. Archives of Pharmacy Practice, 17(2), 21-29. https://doi.org/10.51847/78i64L2M3E

Download Citation
References
  1. Finlayson SG, Subbaswamy A, Singh K, Bowers J, Kupke A, Zittrain J, et al. The clinician and dataset shift in artificial intelligence. N Engl J Med. 2021;385(3):283-6. doi:10.1056/NEJMc2104626
  2. Kelly CJ, Karthikesalingam A, Suleyman M, Corrado G, King D. Key challenges for delivering clinical impact with artificial intelligence. BMC Med. 2019;17(1):195. doi:10.1186/s12916-019-1426-2
  3. Wiens J, Saria S, Sendak M, Ghassemi M, Liu VX, Doshi-Velez F, et al. Do no harm: A roadmap for responsible machine learning for health care. Nat Med. 2019;25(9):1337-40. doi:10.1038/s41591-019-0548-6
  4. Cabitza F, Rasoini R, Gensini GF. Unintended consequences of machine learning in medicine. JAMA. 2017;318(6):517-8. doi:10.1001/jama.2017.7797
  5. Hatzimanolis J, Riley B, El-Den S, Aslani P, Zhou J, Chaar BB. Applications of artificial intelligence in current pharmacy practice: A scoping review. Res Social Adm Pharm. 2025;21(3):134-41. doi:10.1016/j.sapharm.2024.12.007
  6. Lu J, Liu A, Dong F, Gu F, Gama J, Zhang G. Learning under concept drift: A review. IEEE Trans Knowl Data Eng. 2019;31(12):2346-63. doi:10.1109/TKDE.2018.2876857
  7. Sato DMV, de Freitas SC, Barddal JP, Scalabrin EE. A survey on concept drift in process mining. ACM Comput Surv. 2022;54(9):189:1-189:38. doi:10.1145/3472752
  8. De Roock E, Martin N. Process mining in healthcare—an updated perspective on the state of the art. J Biomed Inform. 2022;127:103995. doi:10.1016/j.jbi.2022.103995
  9. Adams JN, van Zelst SJ, Rose T, van der Aalst WMP. Explainable concept drift in process mining. Inf Syst. 2023;114:102177. doi:10.1016/j.is.2023.102177
  10. Carayon P, Wooldridge A, Hose BZ, Salwei M, Benneyan J. Challenges and opportunities for improving patient safety through human factors and systems engineering. Health Aff (Millwood). 2018;37(11):1862-9. doi:10.1377/hlthaff.2018.0723
  11. Carayon P, Wooldridge A, Hoonakker P, Schoofs Hundt A, Kelly MM. SEIPS 3.0: Human-centered design of the patient journey for patient safety. Appl Ergon. 2020;84:103033. doi:10.1016/j.apergo.2019.103033
  12. Topol EJ. High-performance medicine: The convergence of human and artificial intelligence. Nat Med. 2019;25(1):44-56. doi:10.1038/s41591-018-0300-7
  13. Graafsma J, Murphy RM, van de Garde EMW, Karapinar-Çarkit F, Derijks HJ, Hoge RHL, et al. The use of artificial intelligence to optimize medication alerts generated by clinical decision support systems: A scoping review. J Am Med Inform Assoc. 2024;31(6):1411-22. doi:10.1093/jamia/ocae076
  14. Hussain MI, Reynolds TL, Zheng K. Medication safety alert fatigue may be reduced via interaction design and clinical role tailoring: A systematic review. J Am Med Inform Assoc. 2019;26(10):1141-9. doi:10.1093/jamia/ocz095
  15. Kore A, Abbasi Bavil E, Subasri V, Abdalla M, Fine B, Dolatabadi E, et al. Empirical data drift detection experiments on real-world medical imaging data. Nat Commun. 2024;15(1):1887. doi:10.1038/s41467-024-46142-w
  16. Lewis AE, Weiskopf N, Abrams ZB, Foraker R, Lai AM, Payne PRO, et al. Electronic health record data quality assessment and tools: A systematic review. J Am Med Inform Assoc. 2023;30(10):1730-40. doi:10.1093/jamia/ocad120
  17. Moy AJ, Hobensack M, Marshall K, Vawdrey DK, Kim EY, Cato KD, et al. Understanding the perceived role of electronic health records and workflow fragmentation on clinician documentation burden in emergency departments. J Am Med Inform Assoc. 2023;30(5):797-808. doi:10.1093/jamia/ocad038
  18. Liu S, McCoy AB, Peterson JF, Lasko TA, Sittig DF, Nelson SD, et al. Leveraging explainable artificial intelligence to optimize clinical decision support. J Am Med Inform Assoc. 2024;31(4):968-74. doi:10.1093/jamia/ocae019
  19. Subbaswamy A, Saria S. From development to deployment: Dataset shift, causality, and shift-stable models in health AI. Biostatistics. 2020;21(2):345-52. doi:10.1093/biostatistics/kxz041
  20. Feng J, Phillips RV, Malenica I, Bishara A, Hubbard AE, Celi LA, et al. Clinical artificial intelligence quality improvement: Towards continual monitoring and updating of AI algorithms in healthcare. NPJ Digit Med. 2022;5(1):66. doi:10.1038/s41746-022-00611-y
  21. Davis SE, Embí PJ, Matheny ME. Sustainable deployment of clinical prediction tools—a 360° approach to model maintenance. J Am Med Inform Assoc. 2024;31(5):1195-8. doi:10.1093/jamia/ocae036
  22. Petersen C, Smith J, Freimuth RR, Goodman KW, Jackson GP, Kannry J, et al. Recommendations for the safe, effective use of adaptive CDS in the US healthcare system: An AMIA position paper. J Am Med Inform Assoc. 2021;28(4):677-84. doi:10.1093/jamia/ocaa319
  23. Vasey B, Nagendran M, Campbell B, Clifton DA, Collins GS, Denaxas S, et al. Reporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI. Nat Med. 2022;28(5):924-33. doi:10.1038/s41591-022-01772-9
  24. Lekadir K, Frangi AF, Porras AR, Glocker B, Cintas C, Langlotz CP, et al. FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcare. BMJ. 2025;388. doi:10.1136/bmj-2024-081554
  25. Wang HE, Landers M, Adams R, Subbaswamy A, Kharrazi H, Gaskin DJ, et al. A bias evaluation checklist for predictive models and its pilot application for 30-day hospital readmission models. J Am Med Inform Assoc. 2022;29(8):1323-33. doi:10.1093/jamia/ocac065
  26. Vokinger KN, Feuerriegel S, Kesselheim AS. Continual learning in medical devices: FDA’s action plan and beyond. Lancet Digit Health. 2021;3(6). doi:10.1016/S2589-7500(21)00076-5
  27. Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A’Court C, et al. Beyond adoption: A new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. 2017;19(11). doi:10.2196/jmir.8775
  28. Damschroder LJ, Reardon CM, Widerquist MAO, Lowery J. The updated Consolidated Framework for Implementation Research based on user feedback. Implement Sci. 2022;17(1):75. doi:10.1186/s13012-022-01245-0
  29. Wenderott K, Krups J, Weigl M, Wooldridge AR. Facilitators and barriers to implementing AI in routine medical imaging: Systematic review and qualitative analysis. J Med Internet Res. 2025;27. doi:10.2196/63649
  30. Corbin CK, Maclay R, Acharya A, Mony S, Punnathanam S, Thapa R, et al. DEPLOYR: A technical framework for deploying custom real-time machine learning models into the electronic medical record. J Am Med Inform Assoc. 2023;30(9):1532-42. doi:10.1093/jamia/ocad114
  31. Obermeyer Z, Powers B, Vogeli C, Mullainathan S. Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019;366(6464):447-53. doi:10.1126/science.aax2342
  32. Seyyed-Kalantari L, Zhang H, McDermott MBA, Chen IY, Ghassemi M. Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations. Nat Med. 2021;27(12):2176-82. doi:10.1038/s41591-021-01595-0
  33. Gianfrancesco MA, Tamang S, Yazdany J, Schmajuk G. Potential biases in machine learning algorithms using electronic health record data. JAMA Intern Med. 2018;178(11):1544-7. doi:10.1001/jamainternmed.2018.3763
  34. Davis SE, Dorn C, Park DJ, Matheny ME. Emerging algorithmic bias: Fairness drift as the next dimension of model maintenance and sustainability. J Am Med Inform Assoc. 2025;32(5):845-54. doi:10.1093/jamia/ocaf039

 

 

 


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.