Abstract
Anterior cruciate ligament (ACL) injuries are a common cause of soft tissue injuries in young active individuals, leading to a significant risk of premature joint degeneration. Postoperative management of such injuries, in particular returning patients to athletic activities, is a challenge with immediate and long-term implications including the risk of subsequent injury. In this study, we present LigaNET, a multi-modal deep learning pipeline that predicts the risk of subsequent ACL injury following surgical treatment. Postoperative MRIs (n=1,762) obtained longitudinally between 3 to 24 months after ACL surgery from a cohort of 159 patients along with 11 non-imaging outcomes were used to train and test: 1) a 3D CNN to predict subsequent ACL injury from segmented ACLs, 2) a 3D CNN to predict injury from the whole MRI, 3) a logistic regression classifier predict injury from non-imaging data, and 4) a multi-modal pipeline by fusing the predictions of each classifier. The CNN using the segmented ACL achieved an accuracy of 77.6% and AUROC of 0.84, which was significantly better than the CNN using the whole knee MRI (accuracy: 66.6%, AUROC: 0.70; P<.001) and the non-imaging classifier (accuracy: 70.1%, AUROC: 0.75; P=.039). The fusion of all three classifiers resulted in highest classification performance (accuracy: 80.6%, AUROC: 0.89), which was significantly better than each individual classifier (P<.001). The developed multi-modal approach had similar performance in predicting the risk of subsequent ACL injury from any of the imaging sequences (P>.10). Our results demonstrate that a deep learning approach can achieve high performance in identifying patients at high risk of subsequent ACL injury after surgery and may be used in clinical decision making to improve postoperative management (e.g., safe return to sports) of ACL injured patients.
Competing Interest Statement
M.M.M. is a founder, paid consultant, and equity holder in Miach Orthopaedics, Inc, which was formed to work on upscaling production of the BEAR scaffold. M.M.M. maintained a conflict-of-interest management plan that was approved by Boston Children's Hospital and Harvard Medical School during the conduct of the trial, with oversight by both conflict-of-interest committees and the institutional review board of Boston Children's Hospital, as well as the US Food and Drug Administration. B.C.F. is an assistant editor for The American Journal of Sports Medicine, the spouse of M.M.M. with the inherently same conflicts. A.M.K. is a paid consultant for Miach Orthopaedics, Inc, maintained a conflict-of-interest management plan that was approved by Boston Children's Hospital and Harvard Medical School during the conduct of the trial, with oversight by both conflict-of-interest committees and the institutional review board of Boston Children's Hospital. For the BEAR Trial Team, D.E.K., L.J.M., and Y.-M.Y. all have disclosures as listed in the American Academy of Orthopaedic Surgeons database, none of which are related to this current project or technology. These include educational payments from Kairos Surgical (D.E.K., Y.-M.Y.) and food, beverage, and travel reimbursements from 5 companies (each <$500). L.J.M. also has received multiple payments for food and beverage from various companies. B.P. has manufactured the scaffolds used in the trials at Boston Children's Hospital and is a paid consultant and equity holder in Miach Orthopaedics at this time, as he assists with transfer of the manufacturing process to the contract manufacturing organization that Miach has engaged to do the manufacturing. N.S. has manufactured scaffolds used in the trials at Boston Children's Hospital and is a paid consultant for Miach Orthopaedics. B.P. and N.S. maintain a conflict-of-interest management plan that was approved by Boston Children's Hospital and Harvard Medical School during the conduct of the trial, with oversight by both conflict-of-interest committees and the institutional review board of Boston Children's Hospital. AMK, MMM, BCF, SWF, DK, AGB are inventors on several patent applications related to MRI-based approaches to evaluate soft tissue healing and risk of injury.
Funding Statement
We would like to acknowledge funding support from: Boston Children's Hospital Research Faculty Council (AMK) Children's Hospital Orthopaedic Surgery Foundation (MMM and AMK) Children's Hospital Sports Medicine Foundation (MMM) Translational Research Program at Boston Children's Hospital (MMM) NIH/NIAMS R01-AR065462 (MMM, BCF and AMK) NIH/NIAMS R01-AR056834 (MMM and BCF) Lucy Lippitt Endowment of Brown University (BCF) Rhode Island Hospital Orthopaedic Surgery Foundation (BCF) NIH/NIGMS P20‐GM103645 and P30‐GM122732 (BCF) Football Players Health Study at Harvard University (MMM and AMK). The Football Players Health Study is funded by a grant from the National Football League Players Association. The content is solely the responsibility of the authors and does not necessarily represent the official views of Harvard Medical School, Harvard University or its affiliated academic health care centers, the National Football League Players Association, Boston Children's Hospital or the National Institutes of Health.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This study was performed in line with the principles of the Declaration of Helsinki. Approval was granted by the Institutional Review Board of Boston Children's Hospital (IRB-P00039967).
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Data Availability
The clinical and imaging data for this study are form a series of FDA-regulated clinical trials (NCT02292004, NCT02664545, NCT03348995), which cannot be publicly shared due to privacy and regulatory issues. These trails have been extensively published. All the necessary details, required to replicate the studies here are included in the main text and supplementary materials. Additional data and models can be requested following proper materials transfer agreements.
