Abstract
Background Transthoracic echocardiography (TTE) is the primary modality for diagnosing aortic valve stenosis (AVS), yet it requires skilled operators and can be resource-intensive. We developed and validated an artificial intelligence (AI)-based system for evaluating AVS that is effective in both resource-limited and advanced settings.
Methods We created a dual-pathway AI system for AVS evaluation using a nationwide echocardiographic dataset (developmental dataset, n=8,427): 1) a deep learning (DL)-based AVS continuum assessment algorithm using limited 2D TTE videos, and 2) automating conventional AVS evaluation. We performed internal (internal test dataset [ITDS], n=841) and external validation (distinct hospital dataset [DHDS], n=1,696; temporally distinct dataset [TDDS], n=772) for diagnostic value across various stages of AVS and prognostic value for composite endpoints (cardiovascular death, heart failure, and aortic valve replacement)
Findings The DL index for the AVS continuum (DLi-AVSc, range 0-100) increases with worsening AVS severity and demonstrated excellent discrimination for any AVS (AUC 0.91– 0.99), significant AVS (0.95–0.98), and severe AVS (0.97–0.99). DLi-AVSc was independent predictor for composite endpoint (adjusted hazard ratios 2.19, 1.64, and 1.61 per 10-point increase in ITDS, DHDS, and TDDS, respectively). Automatic measurement of conventional AVS parameters demonstrated excellent correlation with manual measurement, resulting in high accuracy for AVS staging (98.2% for ITDS, 81.0% for DHDS, and 96.8% for TDDS) and comparable prognostic value to manually-derived parameters.
Interpretation The AI-based system provides accurate and prognostically valuable AVS assessment, suitable for various clinical settings. Further validation studies are planned to confirm its effectiveness across diverse environments.
Funding This work was supported by a grant from the Institute of Information & communications Technology Planning & Evaluation (IITP) funded by the Korea government (Ministry of Science and ICT) (No.2022000972, Development of a Flexible Mobile Healthcare Software Platform Using 5G MEC); and the Medical AI Clinic Program through the NIPA funded by the MSIT. (Grant No.: H0904-24-1002). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Evidence before this study We screened all English-based research articles in PubMed up to December 2023 using the keywords “artificial intelligence,” “echocardiography,” and “aortic valve stenosis.” While some studies have used artificial intelligence (AI) to evaluate aortic valve stenosis (AVS) in echocardiography, these efforts were typically focused on either predicting significant AVS or automating conventional measurements, not both. For instance, Holste G. et al. trained a deep learning model on 5,257 studies and validated it using two external datasets (4,226 and 3,072 studies), achieving high accuracy in detecting severe AVS (area under the receiver operating characteristic curve (AUC): 0.942–0.952). However, their model was limited to the parasternal long-axis view and did not provide conventional quantitative analysis. In contrast, Krishna H. et al. automated conventional AVS evaluation, demonstrating that AI could accurately measure AVS parameters like aortic valve maximal velocity, mean pressure gradient, and aortic valve area in 256 patients, comparable to human measurements, but did not perform qualitative assessment of AVS. Furthermore, no studies investigated the prognostic value of AI-based AVS assessment.
Added value of this study In this study, we developed a comprehensive AI-based system to evaluate AVS through a dual pathway: 1) assessing AVS presence and severity by deriving a DL index for the AVS continuum (DLi-AVSc) from parasternal long and/or short axis videos only, and 2) automatically measuring AVS parameters and providing conventional quantitative AVS evaluation if additional images are available. The system was validated internally and in two independent external datasets, where DLi-AVSc increased with AVS severity and demonstrated excellent discrimination for any AVS (AUC 0.91–0.99), significant AVS (0.95– 0.98), and severe AVS (0.97–0.99). Additionally, DLi-AVSc independently predicted adverse cardiovascular events. The automatic measurement of conventional AVS parameters showed a strong correlation with manual measurement, resulting in high accuracy for AVS staging (98.2% for internal test set, 81.0%, and 96.8% for external test sets) and offered prognostic value comparable to manually-derived parameters.
Implications of all the available evidence AI-enhanced echocardiographic evaluation of AVS allows for accurate diagnosis of significant AVS and prediction of severity using only parasternal long or short axis views, typically obtained in the first step of echocardiographic evaluation. This capability can enhance AVS assessment in resource-limited settings and provide novices with guidance on when quantitative analysis is necessary. If additional views are acquired, the system automatically analyses them, enabling conventional quantitative evaluation, thereby saving time and effort while ensuring accurate assessment. Our study findings support the clinical implementation of AI-enhanced echocardiographic analysis.
Competing Interest Statement
Y.E.Y. is Chief Medical Officer of Ontact Health, Inc. J.J., Y.J., Y.H., and S.A.L. are currently affiliated with Ontact Health, Inc. J.J., J.K., and S.A.L are co-inventors on a patent related to this work filed by Ontact Health (METHOD FOR PROVIDING INFORMATION ON SEVERITY OF AORTIC STENOSIS AND DEVICE USING THE SAME). H.J.C. holds stock in Ontact Health, Inc. The other authors have no conflicts of interest to declare.
Funding Statement
This work was supported by a grant from the Institute of Information & communications Technology Planning & Evaluation (IITP) funded by the Korea government (Ministry of Science and ICT) (No.2022000972, Development of a Flexible Mobile Healthcare Software Platform Using 5G MEC); and the Medical AI Clinic Program through the NIPA funded by the MSIT. (Grant No.: H0904-24-1002). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The institutional review board of Seoul National University Bundang Hospital and Severance Hospital approved this study and waived the requirement for informed consent because of the retrospective and observational nature of the study design.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Footnotes
Updated and refined content for improved clarity and accuracy
Data Availability
The AI-based frameworks utilized in this study were developed and validated using the Open AI Dataset Project (AI-Hub) dataset, an initiative supported by the South Korean government's Ministry of Science and ICT.
