Artificial intelligence (AI) outperformed echocardiogram assessments made by sonographers in assessing and diagnosing cardiac function, says new study published in the peer-reviewed journal Nature.
The study evaluated 3,495 transthoracic echocardiogram studies by comparing initial assessments made by AI or by a sonographer. The investigators found that AI was more accurate in evaluating the studies. The findings have immediate implications for patients undergoing cardiac function imaging, as well as broader implications for the field of cardiac imaging.
The study was a blinded, randomized clinical trial of AI in cardiology, led by investigators at the Smidt Heart Institute and the Division of Artificial Intelligence in Medicine at Cedars-Sinai.
Cardiologist David Ouyang, MD, the principal investigator of the clinical trial and senior author of the study, said, "This trial offers rigorous evidence that utilizing AI in this novel way can improve the quality and effectiveness of echocardiogram imaging for many patients."
The researchers are confident that the technology will be found beneficial when deployed across the clinical system at Cedars-Sinai and health systems nationwide. The study highlights the potential of AI in improving the accuracy and effectiveness of medical imaging, which can help improve patient outcomes and reduce healthcare costs. The results of this study are particularly relevant in the context of the COVID-19 pandemic, which has put a strain on healthcare systems and increased the need for remote and automated medical imaging solutions. The use of AI in medical imaging can help overcome these challenges and improve patient care.
"This successful clinical trial sets a superb precedent for how novel clinical AI algorithms can be discovered and tested within health systems, increasing the likelihood of seamless deployment for improved patient care," said Sumeet Chugh, director of the Division of Artificial Intelligence in Medicine and the Pauline and Harold Price Chair in Cardiac Electrophysiology Research.
In 2020, researchers at the Smidt Heart Institute and Stanford University developed one of the first AI technologies to assess cardiac function, specifically, left ventricular ejection fraction -- the key heart measurement used in diagnosing cardiac function. Their research also was published in Nature.
Building on those findings, the new study assessed whether AI was more accurate in evaluating 3,495 transthoracic echocardiogram studies by comparing initial assessment by AI or by a sonographer -- also known as an ultrasound technician.
Among the findings:
Cardiologists more frequently agreed with the AI initial assessment and made corrections to only 16.8% of the initial assessments made by AI.
Cardiologists made corrections to 27.2% of the initial assessments made by the sonographers.
The physicians were unable to tell which assessments were made by AI and which were made by sonographers.
The AI assistance saved cardiologists and sonographers time.
"We asked our cardiologists to guess if the preliminary interpretation was performed by AI or by a sonographer, and it turns out that they couldn't tell the difference," said Ouyang. "This speaks to the strong performance of the AI algorithm as well as the seamless integration into clinical software. We believe these are all good signs for future AI trial research in the field."
The hope, Ouyang says, is to save clinicians time and minimize the more tedious parts of the cardiac imaging workflow. The cardiologist, however, remains the final expert adjudicator of the AI model output.
The clinical trial and subsequent published research also shed light on the opportunity for regulatory approvals.
"This work raises the bar for artificial intelligence technologies being considered for regulatory approval, as the Food and Drug Administration has previously approved artificial intelligence tools without data from prospective clinical trials," said Susan Cheng, MD, MPH, director of the Institute for Research on Healthy Aging in the Department of Cardiology at the Smidt Heart Institute and co-senior author of the study. "We believe this level of evidence offers clinicians extra assurance as health systems work to adopt artificial intelligence more broadly as part of efforts to increase efficiency and quality overall."
