
Integrating AI Pipelines Into The Diagnosis Of Cardiomyopathies
- | By Ultromics
Ashley P. Akerman1, Will Hawkes1, Jeremy Slivnick2, Jorge Oliveira1, Gary Woodward1, Izhan Hamza3, Viral K. Desai3, Martha Grogan3, Christopher G. Scott3, Halley N. Davison3, Juan Cotella2, Matthew Maurer4, Stephen Helmke4, Marielle Scherrer-Crosbie5, Marwa Soltani5, Akash Goyal6, Karolina M. Zareba6, Richard Cheng7, James N. Kirkpatrick7, Tetsuji Kitano8, Masaaki Takeuchi8, Viviane Tiemi Hotta9, Marcelo Luiz Campos Vieira9, Pablo Elissamburu10, Ricardo E. Ronderos10, Aldo Prado11, Efstratios Koutroumpakis12, Anita Deswal12, Amit Pursnani13, Nitasha Sarswat2, Amit M. Patel14, Karima Addetia2, Frederick L. Ruberg15, Michael Randazzo2, Federico M. Asch16, Sarah Cuddy17, Roberto M. Lang2, Patricia A. Pellikka3, Ross Upton1
1Ultromics, Ltd., Oxford, UK; 2University of Chicago, Chicago, IL; 3Mayo Clinic, Rochester, MN; 4Columbia University, New York, NY; 5University of Pennsylvania, Philadelphia, PA; 6Ohio State University, Columbus, OH; 7University of Washington, Seattle, WA; 8Hospital of University of Occupational and Environmental Health, Kitakyushu, Japan; 9Heart Institute (InCor), Sao Paolo, Brazil; 10ICBA, Buenos Aires, Argentina; 11Centro Privado de Cardiología, Tucuman, Argentina; 12University of Texas MD Anderson Cancer Center, Houston, Texas; 13NorthShore, Evanston, IL; 14University of Virginia Medical Center, Charlottesville, VA; 15Boston University Chobanian & Avedisian School of Medicine, Boston, MA; 16MedStar Health Research Institute, Washington, DC;
17Brigham & Women’s Hospital
Background
The differentiation between heart failure with preserved ejection fration (HFpEF) and cardiac amyloidosis (CA) is critical for correct clinical management. Artificial intelligence (AI) has demonstrated promise in aiding clinicians to make complex decisions, but understanding how such models might be deployed in the real-world is important.
Methods
Two artificial intelligence models have been developed to aid in the screening for HFpEF (EchoGo Heart Failure) and CA (EchoGo Amyloidosis). Three-dimensional convolutional neural networks were independently trained to identify HFpEF1 and CA2 on apical four chamber videos from transthoracic echocardiograms. Both models return a classification of positive or negative for disease, and EchoGo Heart Failure is supplemented with a continuous estimate of disease probability. Patients from an external validation study, collected from 17 clinical sites, was used to test the implementation of the two models. The output of the two AI models separately and combined, was tested to understand how they might be implemented in the real world for maximum utility. Model performance (classification) is presented under different implementation scenarios.
Results
From a larger external validation dataset, 1270 patients with HFpEF or cardiac amyloidosis were identified (Table 1). The two models demonstrated high accuracy in the populations they were developed (Table 2). The two models were utilized together to examine how funneling of potential HFpEF patients into cardiac amyloidosis screening might be used (Figure 1 and Table 2). In a workflow where a positive output by either model would initiate further diagnostic testing for cardiac amyloidosis, 91.5% (88.4, 94.0%) of cardiac amyloidosis patients would be correctly identified (sensitivity). More sophisticated workflows incorporating rule-in and rule-out probability thresholds for entry into the funnel were examined (Table 2).
Discussion and Conclusion
Two recently developed models can be utilized independently and in combination to assist in detection of otherwise complex clinical diagnoses. Ongoing prospective and retrospective research will identify the optimal approach to provide maximum clinical utility.