Healthcare Systems Launch Collaborative to Evaluate and Rank Top AI Models for Clinical Use

The Healthcare AI Challenge Collaborative has been launched by a consortium of health systems, including Boston-based Mass General Brigham, to address the rapid integration of AI into the healthcare sector by testing and ranking top AI models[1][2]. This initiative arose from the need to evaluate the efficacy and suitability of rapidly proliferating AI offerings from technology giants like Google, Amazon, and Microsoft[2]. Participating health systems, which include Emory Healthcare and the radiology departments at the University of Wisconsin and the University of Washington, test AI models in simulated clinical settings to establish standardized metrics for evaluation[1]. The collaborative aims to facilitate informed decision-making and foster health equity by providing a comprehensive leaderboard of AI tools[1].