Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Prognostic accuracy of emergency department triage tools for adults with suspected COVID-19: The PRIEST observational cohort study

View ORCID ProfileBen Thomas, Steve Goodacre, Ellen Lee, Laura Sutton, Amanda Loban, Simon Waterhouse, Richard Simmonds, Katie Biggs, Carl Marincowitz, Jose Schutter, Sarah Connelly, Elena Sheldon, Jamie Hall, Emma Young, Andrew Bentley, Kirsty Challen, Chris Fitzimmons, Tim Harris, Fiona Lecky, Andrew Lee, Ian Maconochie, Darren Walter
doi: https://doi.org/10.1101/2020.09.02.20185892
Ben Thomas
1Study Manager, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ben Thomas
  • For correspondence: b.d.thomas{at}sheffield.ac.uk b.d.thomas{at}sheffield.ac.uk
Steve Goodacre
2Professor of Emergency Medicine, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: s.goodacre{at}sheffield.ac.uk
Ellen Lee
3Statistician, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: e.lee{at}sheffield.ac.uk
Laura Sutton
4Statistician/Research Associate, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: l.j.sutton{at}sheffield.ac.uk
Amanda Loban
5Head of Data Management, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: a.loban{at}sheffield.ac.uk
Simon Waterhouse
6Lead Data Specialist, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: s.waterhouse{at}sheffield.ac.uk
Richard Simmonds
7Data Management/Information Systems Officer, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: r.p.simmonds{at}sheffield.ac.uk
Katie Biggs
8Assistant Director, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: c.e.biggs{at}sheffield.ac.uk
Carl Marincowitz
9Clinical Lecturer in Emergency Medicine, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: c.marincowitz{at}sheffield.ac.uk
Jose Schutter
10Research Assistant, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: j.schutter{at}sheffield.ac.uk
Sarah Connelly
11Research Assistant, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: s.l.connelly{at}sheffield.ac.uk
Elena Sheldon
12Research Assistant, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: e.m.sheldon{at}sheffield.ac.uk
Jamie Hall
13Research Assistant, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: jamie.hall{at}sheffield.ac.uk
Emma Young
14Research Assistant, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: e.l.young{at}sheffield.ac.uk
Andrew Bentley
15Consultant in ICM & Respiratory Medicine, Manchester University NHS Foundation Trust, Wythenshawe Hospital, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: andrew.bentley{at}manchester.ac.uk
Kirsty Challen
16Consultant in Emergency Medicine, Lancashire Teaching Hospitals NHS Foundation Trust, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: kirsty.challen{at}lthtr.nhs.uk
Chris Fitzimmons
17Consultant in Paediatric Emergency Medicine, Sheffield Children’s NHS Foundation Trust, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: c.fitzsimmons{at}nhs.net
Tim Harris
18Professor of Emergency Medicine, Barts Health NHS Trust, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: Tim.Harris{at}bartshealth.nhs.uk
Fiona Lecky
19Clinical Professor in Emergency Medicine, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: f.e.lecky{at}sheffield.ac.uk
Andrew Lee
20Reader of Global Public Health, University of Sheffield, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: andrew.lee{at}sheffield.ac.uk
Ian Maconochie
21Consultant in Paediatric Emergency Medicine, Imperial College Healthcare NHS Trust, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: I.maconochie{at}ic.ac.uk
Darren Walter
22Consultant in Emergency Medicine, Manchester University NHS Foundation Trust, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: darren.walter{at}manchester.ac.uk
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Objectives The World Health Organisation (WHO) and National Institute for Health and Care Excellence (NICE) recommend various triage tools to assist decision-making for patients with suspected COVID-19. We aimed to estimate the accuracy of triage tools for predicting severe illness in adults presenting to the emergency department (ED) with suspected COVID-19 infection.

Methods We undertook a mixed prospective and retrospective observational cohort study in 70 EDs across the United Kingdom (UK). We collected data from people attending with suspected COVID-19 between 26 March 2020 and 28 May 2020, and used presenting data to determine the results of assessment with the following triage tools: the WHO algorithm, NEWS2, CURB-65, CRB-65, PMEWS and the swine flu adult hospital pathway (SFAHP). We used 30-day outcome data (death or receipt of respiratory, cardiovascular or renal support) to determine prognostic accuracy for adverse outcome.

Results We analysed data from 20892 adults, of whom 4672 (22.4%) died or received organ support (primary outcome), with 2058 (9.9%) receiving organ support and 2614 (12.5%) dying without organ support (secondary outcomes). C-statistics for the primary outcome were: CURB-65 0.75; CRB-65 0.70; PMEWS 0.77; NEWS2 (score) 0.77; NEWS2 (rule) 0.69; SFAHP (6-point) 0.70; SFAHP (7-point) 0.68; WHO algorithm 0.61. All triage tools showed worse prediction for receipt of organ support and better prediction for death without organ support.

At the recommended threshold, PMEWS and the WHO criteria showed good sensitivity (0.96 and 0.95 respectively), at the expense of specificity (0.31 and 0.27 respectively). NEWS2 showed similar sensitivity (0.96) and specificity (0.28) when a lower threshold than recommended was used.

Conclusion CURB-65, PMEWS and NEWS2 provide good but not excellent prediction for adverse outcome in suspected COVID-19, and predicted death without organ support better than receipt of organ support. PMEWS, the WHO criteria and NEWS2 (using a lower threshold than usually recommended) provide good sensitivity at the expense of specificity.

Registration ISRCTN registry, ISRCTN28342533, http://www.isrctn.com/ISRCTN28342533

Competing Interest Statement

All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: grant funding to their employing institutions from the National Institute for Health Research; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.

Clinical Trial

ISRCTN28342533

Clinical Protocols

http://www.isrctn.com/ISRCTN28342533

https://www.sheffield.ac.uk/scharr/research/centres/cure/priest

https://www.fundingawards.nihr.ac.uk/award/11/46/07

Funding Statement

The PRIEST study was funded by the United Kingdom National Institute for Health Research Health Technology Assessment (HTA) programme (project reference 11/46/07). The funder played no role in the study design; in the collection, analysis, and interpretation of data; in the writing of the report; and in the decision to submit the article for publication. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The North West - Haydock Research Ethics Committee gave a favourable opinion on the PAINTED study on 25 June 2012 (reference 12/NW/0303) and on the updated PRIEST study on 23rd March 2020. The Confidentiality Advisory Group of the Health Research Authority granted approval to collect data without patient consent in line with Section 251 of the National Health Service Act 2006.

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

Anonymised data are available from the corresponding author upon reasonable request (contact details on first page). The Confidentiality Advisory Group of the Health Research Authority will need to consider any requests for data to be used for purposes other than those specified in our application, so a data request should be accompanied by explanation of the purpose of the request and justification of the public benefit. We also recommend inclusion of a pre-specified plan of analysis.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted September 07, 2020.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Prognostic accuracy of emergency department triage tools for adults with suspected COVID-19: The PRIEST observational cohort study
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Prognostic accuracy of emergency department triage tools for adults with suspected COVID-19: The PRIEST observational cohort study
Ben Thomas, Steve Goodacre, Ellen Lee, Laura Sutton, Amanda Loban, Simon Waterhouse, Richard Simmonds, Katie Biggs, Carl Marincowitz, Jose Schutter, Sarah Connelly, Elena Sheldon, Jamie Hall, Emma Young, Andrew Bentley, Kirsty Challen, Chris Fitzimmons, Tim Harris, Fiona Lecky, Andrew Lee, Ian Maconochie, Darren Walter
medRxiv 2020.09.02.20185892; doi: https://doi.org/10.1101/2020.09.02.20185892
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Prognostic accuracy of emergency department triage tools for adults with suspected COVID-19: The PRIEST observational cohort study
Ben Thomas, Steve Goodacre, Ellen Lee, Laura Sutton, Amanda Loban, Simon Waterhouse, Richard Simmonds, Katie Biggs, Carl Marincowitz, Jose Schutter, Sarah Connelly, Elena Sheldon, Jamie Hall, Emma Young, Andrew Bentley, Kirsty Challen, Chris Fitzimmons, Tim Harris, Fiona Lecky, Andrew Lee, Ian Maconochie, Darren Walter
medRxiv 2020.09.02.20185892; doi: https://doi.org/10.1101/2020.09.02.20185892

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Emergency Medicine
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)