ABSTRACT
Purpose This study evaluates the performance of an artificial intelligence based triage and notification system that analyzes fundus photographs for nine signs: cotton wool spots, dot & blot hemorrhages, drusens, flame shaped hemorrhages, glaucomatous disc, hard exudates, retinal neovascularization, preretinal hemorrhage and vascular tortuosity. These signs may be present in multiple retinal diseases.
Methods In a blinded and adjudicated study, a set of 3484 photographs of unique eyes from 3305 patients, from 15 fundus cameras, were graded by retina specialists, and the results compared with an AI-based system.
Results The AI performed at a mean sensitivity of 90.19% and a mean specificity of 88.38% across all signs. The best performance was in detecting glaucomatous disc with a sensitivity of 94.65% and a specificity of 95.36%. The worst performance for sensitivity was for detecting vascular tortuosity at 85.06% and that for specificity was for detecting drusens 85.21%.
Conclusion The AI-based system performs at acceptable sensitivity and specificity levels in comparison to retina specialists in a large sample pooled across 15 fundus cameras for 9 different clinical signs.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
This study did not receive any funding
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
Ethics committee and institutional review board of Dr Shroff's Charity Eye Hospital, New Delhi
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Funding Information - None
Commercial Relationship Disclosures - None
Data Availability
All data produced in the present work are contained in the manuscript
