Quality Assessment of AI Tools in Radiology

• Activity Number: 400 - Challenges and Opportunities for the Principled Calibration and QA/QC Assessments of AI and Machine Learning Methods Within Medical Device Applications
• Type: Invited
• Date/Time: Wednesday, August 10, 2022 : 10:30 AM to 12:20 PM
• Sponsor: Section on Medical Devices and Diagnostics
• Author(s): Arvind Rao*
• Companies: University of Michigan
• Keywords: imaging informatics; AI as device; SaMD; QA/QC; performance scoring metrics

Abstract

Given the wide variety of AI tools currently being deployed in radiology and pathlogy, it is feasible to bring AI to clinical care. However, the calibration of these tools (i.e, the data, the models and inference) for cost-sensitive situations like healthcare is an important point. Using the example of tumr segmentation task, we will review a few algorithms and describe their potential modes of failure in addition to scoring rubrics related to data and model veracity. Joint work with Snehal Prabhudesai, Vinayak Ahluwalia and Nick Wang.