I'm Joe - an NIHR Clinical Lecturer working at the University of Birmingham, UK.Â
My clinical specialities are anaesthesia and intensive care medicine.
My PhD focused on the governance, oversight and assurance of AI, predictive models, and other data-driven health technologies.
 We ask 3 main questions:
Are they safe?
Are they effective?Â
Are they equitable?
To learn more about what we do, visit https://www.cersi-ai.org/Â
The Faculty of Intensive Care Medicine has published a position statement on medical AI. To read it, visit https://www.ficm.ac.uk/standardssafetyguidelinesclinicalquality/ficm-position-statement-on-medical-aiÂ
The final STANDING Together recommendations have now been published in The Lancet Digital Health and NEJM-AI. To learn more or to read the full paper, visit www.datadiversity.org/recommendationsÂ
U.S. Food and Drug Administration. âArtificial Intelligence and Machine Learning (AI/ML)-Enabled Medical Devicesâ. FDA, 2023. https://www.fda.gov/medical-devices/software-medical-device-samd/artificial-intelligence-and-machine-learning-aiml-enabled-medical-devices.
Liu, Xiaoxuan, Livia Faes, Aditya U. Kale, Siegfried K. Wagner, Dun Jack Fu, Alice Bruynseels, Thushika Mahendiran, et al. âA Comparison of Deep Learning Performance against Health-Care Professionals in Detecting Diseases from Medical Imaging: A Systematic Review and Meta-Analysisâ. The Lancet Digital Health 1, no. 6 (1 October 2019): e271â97. https://doi.org/10.1016/S2589-7500(19)30123-2.
Saab, Khaled, Tao Tu, Wei-Hung Weng, Ryutaro Tanno, David Stutz, Ellery Wulczyn, Fan Zhang, et al. âCapabilities of Gemini Models in Medicineâ. arXiv, 1 May 2024. https://doi.org/10.48550/arXiv.2404.18416.
Ng, Annie Y., Cary J. G. Oberije, Ăva AmbrĂłzay, Endre SzabĂł, Orsolya SerfĆzĆ, Edit Karpati, Georgia Fox, et al. âProspective Implementation of AI-Assisted Screen Reading to Improve Early Detection of Breast Cancerâ. Nature Medicine 29, no. 12 (December 2023): 3044â49. https://doi.org/10.1038/s41591-023-02625-9.
Wong, Andrew, Erkin Otles, John P. Donnelly, Andrew Krumm, Jeffrey McCullough, Olivia DeTroyer-Cooley, Justin Pestrue, et al. âExternal Validation of a Widely Implemented Proprietary Sepsis Prediction Model in Hospitalized Patientsâ. JAMA Internal Medicine 181, no. 8 (1 August 2021): 1065â70. https://doi.org/10.1001/jamainternmed.2021.2626.
Cao, Jie, Xiaosong Zhang, Vahakn Shahinian, Huiying Yin, Diane Steffick, Rajiv Saran, Susan Crowley, et al. âGeneralizability of an Acute Kidney Injury Prediction Model across Health Systemsâ. Nature Machine Intelligence 4, no. 12 (December 2022): 1121â29. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10751025/Â
Obermeyer, Ziad, Brian Powers, Christine Vogeli, and Sendhil Mullainathan. âDissecting Racial Bias in an Algorithm Used to Manage the Health of Populationsâ. Science 366, no. 6464 (25 October 2019): 447â53. https://doi.org/10.1126/science.aax2342.
Seyyed-Kalantari, Laleh, Haoran Zhang, Matthew B. A. McDermott, Irene Y. Chen, and Marzyeh Ghassemi. âUnderdiagnosis Bias of Artificial Intelligence Algorithms Applied to Chest Radiographs in Under-Served Patient Populationsâ. Nature Medicine 27, no. 12 (December 2021): 2176â82. https://doi.org/10.1038/s41591-021-01595-0.
Chen, Irene Y., Emma Pierson, Sherri Rose, Shalmali Joshi, Kadija Ferryman, and Marzyeh Ghassemi. âEthical Machine Learning in Healthcareâ. Annual Review of Biomedical Data Science 4 (July 2021): 123â44. https://doi.org/10.1146/annurev-biodatasci-092820-114757.
âAI Act | Shaping Europeâs Digital Futureâ, 30 July 2024. https://digital-strategy.ec.europa.eu/en/policies/regulatory-framework-ai.
GOV.UK. âAI Airlock: The Regulatory Sandbox for AIaMDâ, 9 May 2024. https://www.gov.uk/government/collections/ai-airlock-the-regulatory-sandbox-for-aiamd.
U.S. Food and Drug Administration, Health Canada, and Medicines and Healthcare products Regulatory Agency. âGood Machine Learning Practice for Medical Device Development: Guiding Principlesâ. FDA, 27 October 2021. https://www.fda.gov/medical-devices/software-medical-device-samd/good-machine-learning-practice-medical-device-development-guiding-principles.
Liu, Xiaoxuan, Ben Glocker, Melissa M. McCradden, Marzyeh Ghassemi, Alastair K. Denniston, and Lauren Oakden-Rayner. âThe Medical Algorithmic Auditâ. The Lancet Digital Health (5 April 2022). https://doi.org/10.1016/S2589-7500(22)00003-6.
Cruz Rivera, Samantha, Xiaoxuan Liu, An-Wen Chan, Alastair K. Denniston, and Melanie J. Calvert. âGuidelines for Clinical Trial Protocols for Interventions Involving Artificial Intelligence: The SPIRIT-AI Extensionâ. Nature Medicine 26, no. 9 (September 2020): 1351â63. https://doi.org/10.1038/s41591-020-1037-7.
Vasey, Baptiste, Myura Nagendran, Bruce Campbell, David A Clifton, Gary S Collins, Spiros Denaxas, Alastair K Denniston, et al. âReporting Guideline for the Early Stage Clinical Evaluation of Decision Support Systems Driven by Artificial Intelligence: DECIDE-AIâ. BMJ, 18 May 2022, e070904. https://doi.org/10.1136/bmj-2022-070904.
Collins, Gary S., Karel G. M. Moons, Paula Dhiman, Richard D. Riley, Andrew L. Beam, Ben Van Calster, Marzyeh Ghassemi, et al. âTRIPOD+AI Statement: Updated Guidance for Reporting Clinical Prediction Models That Use Regression or Machine Learning Methodsâ. BMJ 385 (16 April 2024): e078378. https://doi.org/10.1136/bmj-2023-078378.
Liu, Xiaoxuan, Samantha Cruz Rivera, David Moher, Melanie J. Calvert, and Alastair K. Denniston. âReporting Guidelines for Clinical Trial Reports for Interventions Involving Artificial Intelligence: The CONSORT-AI Extensionâ. Nature Medicine 26, no. 9 (September 2020): 1364â74. https://doi.org/10.1038/s41591-020-1034-x.
âJMIR Research Protocols - Target Product Profile for a Machine LearningâAutomated Retinal Imaging Analysis Software for Use in English Diabetic Eye Screening: Protocol for a Mixed Methods Studyâ. Accessed 12 August 2024. https://www.researchprotocols.org/2024/1/e50568.
Alderman JE, Palmer J, Laws E, McCradden MD, Ordish J, Ghassemi M, Pfohl SR, et al. âTackling Algorithmic Bias and Promoting Transparency in Health Datasets: The STANDING Together Consensus Recommendationsâ. NEJM AI 2, no. 1 (January 2025): AIp2401088. https://doi.org/10.1056/AIp2401088.
Alderman JE, Palmer J, Laws E, McCradden MD, Ordish J, Ghassemi M, Pfohl SR, et al. âTackling Algorithmic Bias and Promoting Transparency in Health Datasets: The STANDING Together Consensus Recommendationsâ. The Lancet Digital Health 7, no. 1 (1 January 2025): e64â88. https://doi.org/10.1016/S2589-7500(24)00224-3.
âEconomic Evaluation for Medical Artificial Intelligence: Accuracy vs. Cost-Effectiveness in a Diabetic Retinopathy Screening Case | Npj Digital Medicineâ. Accessed 12 August 2024. https://www.nature.com/articles/s41746-024-01032-9.
âThe Environmental Cost of AIâ. Accessed 12 August 2024. https://www.ft.com/content/323299dc-d9d5-482e-9442-f4516f6753f0.