Nature Portfolio reposted this
Do AI systems outperform doctors? Karin Jongsma, Megan Milota, Anne van den Brink, and I have noticed an increasing number of academic reports suggesting that AI outperforms physicians in various medical tasks and specialisms. Yet, at the same time, we observed that claims of AI outperforming human practitioners are under scrutiny, as model performance is often evaluated in unrealistic settings, and authors may exaggerate findings. This is problematic as overpromising language can be misinterpreted by readers, including the media and the public, and pose harm to patients when AI is implemented on the basis of overly positive claims. In our recently published comment, we therefore argue that it is vital to carefully assess claims of AI outperforming medical practitioners. To support the critical appraisal of outperformance claims, we have formulated ethical guidance targeted at authors, journal editors, and peer reviewers. We maintain that it is crucial to check whether an outperformance claim is (1) precisely formulated, (2) accompanied by a clear description of its implications, and (3) devoid of speculation. We believe that this guidance forms an essential addition to current reporting guidelines for healthcare studies using machine learning. 👉 If you are interested in reading our full comment titled ''Ethical guidance for reporting and evaluating claims of AI outperforming human doctors'', published in NPJ Digital Medicine, see: https://lnkd.in/e5fysfWD Nature Portfolio UMC Utrecht Bioethics & Health Humanities - UMC Utrecht