Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Evaluating the Clinical Feasibility of an Artificial Intelligence-Powered Clinical Decision Support System: A Longitudinal Feasibility Study

Christina Popescu, Grace Golden, David Benrimoh, Myriam Tanguay-Sela, Dominique Slowey, Eryn Lundrigan, Jérôme Williams, Bennet Desormeau, Divyesh Kardani, Tamara Perez, Colleen Rollins, Sonia Israel, Kelly Perlman, Caitrin Armstrong, Jacob Baxter, Kate Whitmore, Marie-Jeanne Fradette, Kaelan Felcarek-Hope, Ghassen Soufi, Robert Fratila, Joseph Mehltretter, Karl Looper, Warren Steiner, Soham Rej, Jordan F. Karp, Katherine Heller, Sagar V. Parikh, Rebecca McGuire-Snieckus, Manuela Ferrari, Howard Margolese, Gustavo Turecki
doi: https://doi.org/10.1101/2021.07.03.21259812
Christina Popescu
1Aifred Health Inc., Canada, Quebec, Montreal, H3C 4A8
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Grace Golden
2University of Waterloo, Canada, Ontario, Waterloo, N2L 3G1
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David Benrimoh
1Aifred Health Inc., Canada, Quebec, Montreal, H3C 4A8
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: david.benrimoh{at}aifredhealth.com
Myriam Tanguay-Sela
1Aifred Health Inc., Canada, Quebec, Montreal, H3C 4A8
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dominique Slowey
3McGill University, Canada, Quebec, Montreal, H3A 0G4
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Eryn Lundrigan
3McGill University, Canada, Quebec, Montreal, H3A 0G4
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jérôme Williams
3McGill University, Canada, Quebec, Montreal, H3A 0G4
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Bennet Desormeau
3McGill University, Canada, Quebec, Montreal, H3A 0G4
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Divyesh Kardani
1Aifred Health Inc., Canada, Quebec, Montreal, H3C 4A8
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tamara Perez
3McGill University, Canada, Quebec, Montreal, H3A 0G4
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Colleen Rollins
4University of Cambridge, United Kingdom, England, Cambridge, CB2 1TN
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sonia Israel
1Aifred Health Inc., Canada, Quebec, Montreal, H3C 4A8
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kelly Perlman
1Aifred Health Inc., Canada, Quebec, Montreal, H3C 4A8
3McGill University, Canada, Quebec, Montreal, H3A 0G4
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Caitrin Armstrong
1Aifred Health Inc., Canada, Quebec, Montreal, H3C 4A8
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jacob Baxter
3McGill University, Canada, Quebec, Montreal, H3A 0G4
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kate Whitmore
3McGill University, Canada, Quebec, Montreal, H3A 0G4
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marie-Jeanne Fradette
3McGill University, Canada, Quebec, Montreal, H3A 0G4
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kaelan Felcarek-Hope
3McGill University, Canada, Quebec, Montreal, H3A 0G4
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ghassen Soufi
3McGill University, Canada, Quebec, Montreal, H3A 0G4
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert Fratila
1Aifred Health Inc., Canada, Quebec, Montreal, H3C 4A8
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joseph Mehltretter
1Aifred Health Inc., Canada, Quebec, Montreal, H3C 4A8
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Karl Looper
3McGill University, Canada, Quebec, Montreal, H3A 0G4
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Warren Steiner
3McGill University, Canada, Quebec, Montreal, H3A 0G4
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Soham Rej
3McGill University, Canada, Quebec, Montreal, H3A 0G4
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jordan F. Karp
5University of Arizona, United States, Arizona, Tucson, 85721
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Katherine Heller
6Duke University, United States, North Carolina, Durham, 27708
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sagar V. Parikh
7University of Michigan, United States, Michigan, Ann Arbor, 48109
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rebecca McGuire-Snieckus
8Barts and the London School of Medicine, United Kingdom, England, London, E1 2AD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Manuela Ferrari
9Douglas Mental Health University Institute, McGill University, Canada, Quebec, Verdun, H4H 1R3
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Howard Margolese
3McGill University, Canada, Quebec, Montreal, H3A 0G4
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gustavo Turecki
9Douglas Mental Health University Institute, McGill University, Canada, Quebec, Verdun, H4H 1R3
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Objective We examine the feasibility of an Artificial Intelligence (AI)-powered clinical decision support system (CDSS), which combines the operationalized 2016 Canadian Network for Mood and Anxiety Treatments guidelines with a neural-network based individualized treatment remission prediction.

Methods Due to COVID-19, the study was adapted to be completed entirely at a distance. Seven physicians recruited outpatients diagnosed with major depressive disorder (MDD) as per DSM-V criteria. Patients completed a minimum of one visit without the CDSS (baseline) and two subsequent visits where the CDSS was used by the physician (visit 1 and 2). The primary outcome of interest was change in session length after CDSS introduction, as a proxy for feasibility. Feasibility and acceptability data were collected through self-report questionnaires and semi-structured interviews.

Results Seventeen patients enrolled in the study; 14 completed. There was no significant difference between appointment length between visits (introduction of the tool did not increase session length). 92.31% of patients and 71.43% of physicians felt that the tool was easy to use. 61.54% of the patients and 71.43% of the physicians rated that they trusted the CDSS. 46.15% of patients felt that the patient-clinician relationship significantly or somewhat improved, while the other 53.85% felt that it did not change.

Conclusions Our results confirm the primary hypothesis that the integration of the tool does not increase appointment length. Findings suggest the CDSS is easy to use and may have some positive effects on the patient-physician relationship. The CDSS is feasible and ready for effectiveness studies.

Competing Interest Statement

Conflicts of Interest: D.B., C.A., R.F., S.I., K.P., M.C. are shareholders and either employees, directors, or founders of Aifred Health. D.K., J.M., are employed by Aifred Health. M.T.S. is employed by Aifred Health and is an options holder. G.G., C.P., K.F.H., G.S., E.L., J.B., J.W., T.P., D.S., B.D., K.W., C.R. have been or are employed or financially compensated by Aifred Health. S.P., K.H., J.K. are members of Aifred Health's scientific advisory board and have received payments or options. W.S., S.B., M.S. are members of the data safety monitoring board. H.M. has received honoraria, sponsorship or grants for participation in speaker bureaus, consultation, advisory board meetings and clinical research from Acadia, Amgen, HLS Therapeutics, Janssen-Ortho, Mylan, Otsuka-Lundbeck, Perdue, Pfizer, Shire and SyneuRx International. S.R reports owning shares in Aifred Health. All other authors report no relevant conflicts.

Clinical Trial

NCT04061642

Funding Statement

Funding sources: Aifred Health Inc.; Innovation Research Assistance Program, National Research Council Canada; ERA-Permed Vision 2020 supporting IMADAPT; Government of Quebec Nova Science; MEDTEQ COVID-Relief Grant.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

This research was reviewed and approved by the Research Ethics Board of the Douglas Mental Health University Institute, Montréal West Island Integrated University Health and Social Services Centre.

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

Inquiries regarding access to study data should be directed to the corresponding author.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted July 07, 2021.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Evaluating the Clinical Feasibility of an Artificial Intelligence-Powered Clinical Decision Support System: A Longitudinal Feasibility Study
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Evaluating the Clinical Feasibility of an Artificial Intelligence-Powered Clinical Decision Support System: A Longitudinal Feasibility Study
Christina Popescu, Grace Golden, David Benrimoh, Myriam Tanguay-Sela, Dominique Slowey, Eryn Lundrigan, Jérôme Williams, Bennet Desormeau, Divyesh Kardani, Tamara Perez, Colleen Rollins, Sonia Israel, Kelly Perlman, Caitrin Armstrong, Jacob Baxter, Kate Whitmore, Marie-Jeanne Fradette, Kaelan Felcarek-Hope, Ghassen Soufi, Robert Fratila, Joseph Mehltretter, Karl Looper, Warren Steiner, Soham Rej, Jordan F. Karp, Katherine Heller, Sagar V. Parikh, Rebecca McGuire-Snieckus, Manuela Ferrari, Howard Margolese, Gustavo Turecki
medRxiv 2021.07.03.21259812; doi: https://doi.org/10.1101/2021.07.03.21259812
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Evaluating the Clinical Feasibility of an Artificial Intelligence-Powered Clinical Decision Support System: A Longitudinal Feasibility Study
Christina Popescu, Grace Golden, David Benrimoh, Myriam Tanguay-Sela, Dominique Slowey, Eryn Lundrigan, Jérôme Williams, Bennet Desormeau, Divyesh Kardani, Tamara Perez, Colleen Rollins, Sonia Israel, Kelly Perlman, Caitrin Armstrong, Jacob Baxter, Kate Whitmore, Marie-Jeanne Fradette, Kaelan Felcarek-Hope, Ghassen Soufi, Robert Fratila, Joseph Mehltretter, Karl Looper, Warren Steiner, Soham Rej, Jordan F. Karp, Katherine Heller, Sagar V. Parikh, Rebecca McGuire-Snieckus, Manuela Ferrari, Howard Margolese, Gustavo Turecki
medRxiv 2021.07.03.21259812; doi: https://doi.org/10.1101/2021.07.03.21259812

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Psychiatry and Clinical Psychology
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)