Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Understanding how the design and implementation of Online Consultations influence primary care outcomes: Systematic review of evidence with recommendations for designers, providers, and researchers

View ORCID ProfileSarah Darley, Tessa Coulson, View ORCID ProfileNiels Peek, View ORCID ProfileSusan Moschogianis, View ORCID ProfileSabine N van der Veer, View ORCID ProfileDavid C Wong, View ORCID ProfileBenjamin C Brown
doi: https://doi.org/10.1101/2022.02.21.22271185
Sarah Darley
1School of Health Sciences, Division of Population Health, Health Services Research and Primary Care, University of Manchester, Manchester, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Sarah Darley
Tessa Coulson
2Salford CCG, Salford, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Niels Peek
3Centre for Health Informatics, Division of Informatics, Imaging and Data Science, Manchester Academic Health Science Centre, University of Manchester, Manchester, UK
4NIHR Greater Manchester Patient Safety Translational Research Centre, School of Health Sciences, University of Manchester, Manchester, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Niels Peek
Susan Moschogianis
1School of Health Sciences, Division of Population Health, Health Services Research and Primary Care, University of Manchester, Manchester, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Susan Moschogianis
Sabine N van der Veer
3Centre for Health Informatics, Division of Informatics, Imaging and Data Science, Manchester Academic Health Science Centre, University of Manchester, Manchester, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Sabine N van der Veer
David C Wong
3Centre for Health Informatics, Division of Informatics, Imaging and Data Science, Manchester Academic Health Science Centre, University of Manchester, Manchester, UK
5Department of Computer Science, University of Manchester, Manchester, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for David C Wong
Benjamin C Brown
1School of Health Sciences, Division of Population Health, Health Services Research and Primary Care, University of Manchester, Manchester, UK
3Centre for Health Informatics, Division of Informatics, Imaging and Data Science, Manchester Academic Health Science Centre, University of Manchester, Manchester, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Benjamin C Brown
  • For correspondence: Benjamin.brown{at}manchester.ac.uk
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Online consultations (OCs) allow patients to contact their care provider online, and have been promoted as a way to address increasing workload and decreasing workforce capacity in primary care. Globally, OCs have been rolled out rapidly due to policy initiatives and the COVID-19 pandemic, though there is a lack of evidence regarding how their design and implementation influence care outcomes.

Objective Informed by existing theories, synthesise quantitative and qualitative research on: 1) outcomes of OCs in primary care; 2) how these are influenced by OC system design and implementation.

Methods We searched Ovid Medline, Embase, Web of Science, Scopus, NTIS, HMIC, and ZETOC from 2010 to November 2021. We included quantitative and qualitative studies of real-world OC use in primary care, written in English, and published 2010 onwards. Quantitative data were transformed into qualitative themes. For objective 1 we used thematic synthesis informed by the Institute of Medicine’s domains of healthcare quality. For objective 2 we used Framework Analysis informed by the NASSS framework and Realistic Evaluation. Critical appraisal was conducted using the Mixed Methods Appraisal Tool and strength of evidence judged using GRADE-CERQual.

Results We synthesised 62 studies (quantitative n=32, qualitative n=12, mixed methods n=18) in nine countries covering 30 unique OC systems, 13 of which used Artificial Intelligence (AI). Twenty-six were published in 2020 onwards, and 11 were post-COVID-19. There was no quantitative evidence for negative impacts of OCs on patient safety, and qualitative studies suggested perceptions of OC safety varied. Some participants believed OCs improved safety, particularly when patients could describe their queries using unstructured free-text. Staff workload decreased when sufficient resources were allocated to implement OCs, and patients used them for simple problems or could describe their queries using free-text. Staff workload increased when OCs were not integrated with other software or organisational workflows, and patients used them for complex queries. OC systems that required patients to describe their queries using multiple choice questionnaires (MCQs) increased workload for both them and staff. Health costs were reduced when patients used OCs for simple queries, and increased when used for complex ones. Patients using OCs were more likely to be female, younger, native speakers, with higher socioeconomic status than those not using OCs. However, OCs increased primary care access for patients with mental health conditions, verbal communication difficulties, and barriers to attending in-person appointments. Access also increased by providing a timely response to patients’ queries. Patient satisfaction increased when using OCs due to better primary care access, though could decrease when using MCQ formats.

Conclusions This is the first theoretically-informed synthesis of research on OCs in primary care, and includes studies conducted during COVID-19. It contributes new knowledge that in addition to producing positive outcomes such as increased access and patient satisfaction, they can also have negative outcomes such as increased workload and costs. These negative outcomes can be mitigated by appropriate OC system design (e.g. free-text format), incorporating advanced technologies (e.g. AI), and integration into technical and organisational workflows (e.g. timely responses).

Study protocol PROSPERO (CRD42020191802).

Competing Interest Statement

Dr Benjamin C Brown is clinical lead for a commercially available OC system (www.patchs.ai).

Clinical Protocols

https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=191802

Funding Statement

This research was funded by Innovate UK (105178) and a Wellcome Trust Clinical Research Career Development Fellowship for BCB (209593/Z/17/Z). NP was partially funded by the National Institute for Health Research Greater Manchester Patient Safety Translational Research Centre (NIHR Greater Manchester PSTRC). The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health and Social Care. NIHR had no role in study design, data collection, data analysis, data interpretation, or writing of the report. The corresponding author had full access to all of the data and the final responsibility to submit for publication.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

All papers reviewed in our systematic review are publicly available.

  • Abbreviations

    AI
    Artificial Intelligence
    EHR
    Electronic Health Record
    GRADE-CERQual
    Grading of Recommendations Assessment, Development, and Evaluation - Confidence in the Evidence from Reviews of Qualitative research
    IOM
    Institute of Medicine
    MMAT
    Mixed Methods Appraisal Tool
    NASSS
    Non-adoption, abandonment, scale-up, spread, sustainability (framework)
    MCQ
    Multiple choice questionnaire
    NHS
    National Health Service
    OCs
    Online Triage and Consultation systems
    PRISMA
    Preferred Reporting Items for Systematic Reviews and Meta-Analyses
    PROSPERO
    The International Prospective Register of Systematic Reviews
    UK
    United Kingdom
    US
    United States
  • Copyright 
    The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
    Back to top
    PreviousNext
    Posted February 21, 2022.
    Download PDF

    Supplementary Material

    Data/Code
    Email

    Thank you for your interest in spreading the word about medRxiv.

    NOTE: Your email address is requested solely to identify you as the sender of this article.

    Enter multiple addresses on separate lines or separate them with commas.
    Understanding how the design and implementation of Online Consultations influence primary care outcomes: Systematic review of evidence with recommendations for designers, providers, and researchers
    (Your Name) has forwarded a page to you from medRxiv
    (Your Name) thought you would like to see this page from the medRxiv website.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Share
    Understanding how the design and implementation of Online Consultations influence primary care outcomes: Systematic review of evidence with recommendations for designers, providers, and researchers
    Sarah Darley, Tessa Coulson, Niels Peek, Susan Moschogianis, Sabine N van der Veer, David C Wong, Benjamin C Brown
    medRxiv 2022.02.21.22271185; doi: https://doi.org/10.1101/2022.02.21.22271185
    Twitter logo Facebook logo LinkedIn logo Mendeley logo
    Citation Tools
    Understanding how the design and implementation of Online Consultations influence primary care outcomes: Systematic review of evidence with recommendations for designers, providers, and researchers
    Sarah Darley, Tessa Coulson, Niels Peek, Susan Moschogianis, Sabine N van der Veer, David C Wong, Benjamin C Brown
    medRxiv 2022.02.21.22271185; doi: https://doi.org/10.1101/2022.02.21.22271185

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    • Tweet Widget
    • Facebook Like
    • Google Plus One

    Subject Area

    • Primary Care Research
    Subject Areas
    All Articles
    • Addiction Medicine (349)
    • Allergy and Immunology (668)
    • Allergy and Immunology (668)
    • Anesthesia (181)
    • Cardiovascular Medicine (2648)
    • Dentistry and Oral Medicine (316)
    • Dermatology (223)
    • Emergency Medicine (399)
    • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
    • Epidemiology (12228)
    • Forensic Medicine (10)
    • Gastroenterology (759)
    • Genetic and Genomic Medicine (4103)
    • Geriatric Medicine (387)
    • Health Economics (680)
    • Health Informatics (2657)
    • Health Policy (1005)
    • Health Systems and Quality Improvement (985)
    • Hematology (363)
    • HIV/AIDS (851)
    • Infectious Diseases (except HIV/AIDS) (13695)
    • Intensive Care and Critical Care Medicine (797)
    • Medical Education (399)
    • Medical Ethics (109)
    • Nephrology (436)
    • Neurology (3882)
    • Nursing (209)
    • Nutrition (577)
    • Obstetrics and Gynecology (739)
    • Occupational and Environmental Health (695)
    • Oncology (2030)
    • Ophthalmology (585)
    • Orthopedics (240)
    • Otolaryngology (306)
    • Pain Medicine (250)
    • Palliative Medicine (75)
    • Pathology (473)
    • Pediatrics (1115)
    • Pharmacology and Therapeutics (466)
    • Primary Care Research (452)
    • Psychiatry and Clinical Psychology (3432)
    • Public and Global Health (6527)
    • Radiology and Imaging (1403)
    • Rehabilitation Medicine and Physical Therapy (814)
    • Respiratory Medicine (871)
    • Rheumatology (409)
    • Sexual and Reproductive Health (410)
    • Sports Medicine (342)
    • Surgery (448)
    • Toxicology (53)
    • Transplantation (185)
    • Urology (165)