Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

A prediction algorithm to improve the accuracy of the Gold Standard Framework Surprise Question end-of-life prognostic categories in an acute hospital admission cohort-controlled study. The Proactive Risk-Based and Data-Driven Assessment of Patients at the End of Life (PRADA)

View ORCID ProfileBaldev Singh, View ORCID ProfileNisha Kumari-Dewat, View ORCID ProfileAdam Ryder, Vijay Klaire, Gemma Bennion, Hannah Jennens, Dawn Matthews, Sophie Rayner, Benoit Ritzenthaler, Jean Shears, Kamran Ahmed, Mona Sidhu, Ananth Viswanath, Kate Warren, Emma Parry
doi: https://doi.org/10.1101/2023.09.07.23295196
Baldev Singh
1New Cross Hospital, The Royal Wolverhampton NHS Trust, Wednesfield Rd, Wolverhampton, UK, WV10 0QP
2Research Institute for Healthcare Sciences, Faculty of Science and Engineering, University of Wolverhampton, MA Building, Wulfruna Street, Wolverhampton | WV1 1LY
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Baldev Singh
  • For correspondence: baldev.singh{at}nhs.net
Nisha Kumari-Dewat
1New Cross Hospital, The Royal Wolverhampton NHS Trust, Wednesfield Rd, Wolverhampton, UK, WV10 0QP
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Nisha Kumari-Dewat
Adam Ryder
1New Cross Hospital, The Royal Wolverhampton NHS Trust, Wednesfield Rd, Wolverhampton, UK, WV10 0QP
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Adam Ryder
Vijay Klaire
1New Cross Hospital, The Royal Wolverhampton NHS Trust, Wednesfield Rd, Wolverhampton, UK, WV10 0QP
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gemma Bennion
1New Cross Hospital, The Royal Wolverhampton NHS Trust, Wednesfield Rd, Wolverhampton, UK, WV10 0QP
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hannah Jennens
1New Cross Hospital, The Royal Wolverhampton NHS Trust, Wednesfield Rd, Wolverhampton, UK, WV10 0QP
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dawn Matthews
1New Cross Hospital, The Royal Wolverhampton NHS Trust, Wednesfield Rd, Wolverhampton, UK, WV10 0QP
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sophie Rayner
3Derriford Hospital, University Hospitals Plymouth, Derriford Road, Plymouth, PL6 8DH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Benoit Ritzenthaler
1New Cross Hospital, The Royal Wolverhampton NHS Trust, Wednesfield Rd, Wolverhampton, UK, WV10 0QP
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jean Shears
1New Cross Hospital, The Royal Wolverhampton NHS Trust, Wednesfield Rd, Wolverhampton, UK, WV10 0QP
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kamran Ahmed
4Pennfields Medical Centre, Upper Zoar St, Wolverhampton, UK, WV3 0JH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mona Sidhu
5Lea Road Medical Practice, 35 Lea Road, Wolverhampton, UK, WV3 0LS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ananth Viswanath
1New Cross Hospital, The Royal Wolverhampton NHS Trust, Wednesfield Rd, Wolverhampton, UK, WV10 0QP
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kate Warren
1New Cross Hospital, The Royal Wolverhampton NHS Trust, Wednesfield Rd, Wolverhampton, UK, WV10 0QP
6The City of Wolverhampton Council, Civic Centre, St Peters Square, Wolverhampton, UK, WV1 1SH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Emma Parry
1New Cross Hospital, The Royal Wolverhampton NHS Trust, Wednesfield Rd, Wolverhampton, UK, WV10 0QP
7School of Medicine, Keele University, University Road, Keele, Staffordshire, UK, ST5 5BG
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Objective To determine the accuracy of a clinical data algorithm allocated end-of-life prognosis amongst hospital inpatients.

Method The model allocated a predicted Gold Standard Framework end-of-life prognosis to all acute medical patients admitted over a 2-year period. Mortality was determined at 1 year.

Results Of 18,838 patients, end-of-life prognosis was unknown in 67.9%. A binary logistic regression model calculated 1-year mortality probability (X2=6650.2, p<0.001, r2 = 0.43). Probability cut off points were used to triage those with unknown prognosis using the GSF Surprise Question “Yes” or “No” survival categories (> or < 1 year respectively), with subsidiary classification of “No” to Green (months), Amber (weeks) or Red (days). This digitally driven prognosis allocation (100% vs baseline 32.1%) yielded cohorts of GSFSQ-Yes 15,264 (81%), GSFSQ-No Green 1,771 (9.4%) and GSFSQ-No Amber or Red 1,803 (9.6%).

There were 5,043 (26.8%) deaths at 1 year. In Cox’s survival, model allocated cohorts were discrete for mortality (GSFSQ-Yes 16.4% v GSFSQ-No 71.0% (p<0.001). For the GSFSQ-No classification, the mortality Odds Ratio was 12.4 (11.4 – 13.5) (p<0.001) vs GSFSQ-Yes (c-statistic of 0.71 (0.70 – 0.73), p<0.001; accuracy, positive and negative predictive values of 81.2%, 83.6%, 83.6% respectively. If this tool had been utilised at the time of admission, the potential to reduce subsequent hospital admissions, death-in-hospital, and bed days was all p<0.001.

Conclusions The defined model successfully allocated end-of-life prognosis in cohorts of hospitalised patients with strong performance metrics for prospective 1 year mortality, yielding the potential to provide anticipatory care and improve outcomes.

What is already known about this topic?End-of-life care is fragmented with excessive hospital admission and death in hospital. Current processes to determine end-of-life prognosis and promote anticipatory care for better outcomes are of limited utility.

What this paper adds?A patient centric data integration model permitted the development of a digital health care system (PRADA) which allows the use of advanced analytics to accurately determine end-of-life prognosis among those where it was otherwise unknown. This paper demonstrates the potential benefit of integrating this prediction tool into routine care, at scale, in large population-level cohorts.

Implications for practice, theory, or policy In an era of advancing opportunity from informatics driven heath care, NHS policy, through commissioning to direct care, must now actively deploy such evidence-based digital systems into direct care, most specifically in data sharing across provider boundaries. We particularly hope the research community might consider testing and validating this approach.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

Non

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Directorate of Research & Development of the Royal Wolverhampton NHS Trust confirmed Ethical approval not required

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Footnotes

  • baldev.singh{at}nhs.net, nisha.kumari{at}nhs.net, a.ryder1{at}nhs.net, vijay.klaire{at}nhs.net, g.bennion{at}nhs.net, hannah.jennens{at}nhs.net, d.matthews10{at}nhs.net, sophie.rayner1{at}nhs.net, britzenthaler{at}nhs.net, jean.shears{at}nhs.net, kamahmed{at}nhs.net, mona.sidhu{at}nhs.net, ananthviswanath{at}nhs.net, kate.warren{at}nhs.net, e.parry{at}keele.ac.uk

Data Availability

All data produced in the present study are available upon reasonable request to the authors

  • Abbreviations Used

    CI
    confidence interval
    DIH
    death in hospital
    EOL
    end of life
    EPaCCS
    Electronic Palliative Care Co-ordination Systems
    EPR
    electronic patient record
    GDPR
    General Data Protection Regulation
    GSF SQ
    Gold Standard Framework Surprise Question
    IA
    index admission
    IMD
    Index of Multiple Deprivation.
    NEA
    non-elective admission
    NHS
    National Health Service
    OR
    Odd’s Ratio
    PCA
    Principal components analysis
    PRADA
    Proactive Risk-Based and Data-Driven Assessment of Patients at the End of Life
    RCT
    randomised controlled trial
    ReSPECT
    Recommended Summary Plan for Emergency Care and Treatment
    ROC
    receiver operating curve
    SD
    standard deviation
    SPCT
    specialist palliative care team
  • Copyright 
    The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-ND 4.0 International license.
    Back to top
    PreviousNext
    Posted September 08, 2023.
    Download PDF
    Data/Code
    Email

    Thank you for your interest in spreading the word about medRxiv.

    NOTE: Your email address is requested solely to identify you as the sender of this article.

    Enter multiple addresses on separate lines or separate them with commas.
    A prediction algorithm to improve the accuracy of the Gold Standard Framework Surprise Question end-of-life prognostic categories in an acute hospital admission cohort-controlled study. The Proactive Risk-Based and Data-Driven Assessment of Patients at t…
    (Your Name) has forwarded a page to you from medRxiv
    (Your Name) thought you would like to see this page from the medRxiv website.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Share
    A prediction algorithm to improve the accuracy of the Gold Standard Framework Surprise Question end-of-life prognostic categories in an acute hospital admission cohort-controlled study. The Proactive Risk-Based and Data-Driven Assessment of Patients at the End of Life (PRADA)
    Baldev Singh, Nisha Kumari-Dewat, Adam Ryder, Vijay Klaire, Gemma Bennion, Hannah Jennens, Dawn Matthews, Sophie Rayner, Benoit Ritzenthaler, Jean Shears, Kamran Ahmed, Mona Sidhu, Ananth Viswanath, Kate Warren, Emma Parry
    medRxiv 2023.09.07.23295196; doi: https://doi.org/10.1101/2023.09.07.23295196
    Twitter logo Facebook logo LinkedIn logo Mendeley logo
    Citation Tools
    A prediction algorithm to improve the accuracy of the Gold Standard Framework Surprise Question end-of-life prognostic categories in an acute hospital admission cohort-controlled study. The Proactive Risk-Based and Data-Driven Assessment of Patients at the End of Life (PRADA)
    Baldev Singh, Nisha Kumari-Dewat, Adam Ryder, Vijay Klaire, Gemma Bennion, Hannah Jennens, Dawn Matthews, Sophie Rayner, Benoit Ritzenthaler, Jean Shears, Kamran Ahmed, Mona Sidhu, Ananth Viswanath, Kate Warren, Emma Parry
    medRxiv 2023.09.07.23295196; doi: https://doi.org/10.1101/2023.09.07.23295196

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    • Tweet Widget
    • Facebook Like
    • Google Plus One

    Subject Area

    • Palliative Medicine
    Subject Areas
    All Articles
    • Addiction Medicine (349)
    • Allergy and Immunology (668)
    • Allergy and Immunology (668)
    • Anesthesia (181)
    • Cardiovascular Medicine (2648)
    • Dentistry and Oral Medicine (316)
    • Dermatology (223)
    • Emergency Medicine (399)
    • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
    • Epidemiology (12228)
    • Forensic Medicine (10)
    • Gastroenterology (759)
    • Genetic and Genomic Medicine (4103)
    • Geriatric Medicine (387)
    • Health Economics (680)
    • Health Informatics (2657)
    • Health Policy (1005)
    • Health Systems and Quality Improvement (985)
    • Hematology (363)
    • HIV/AIDS (851)
    • Infectious Diseases (except HIV/AIDS) (13695)
    • Intensive Care and Critical Care Medicine (797)
    • Medical Education (399)
    • Medical Ethics (109)
    • Nephrology (436)
    • Neurology (3882)
    • Nursing (209)
    • Nutrition (577)
    • Obstetrics and Gynecology (739)
    • Occupational and Environmental Health (695)
    • Oncology (2030)
    • Ophthalmology (585)
    • Orthopedics (240)
    • Otolaryngology (306)
    • Pain Medicine (250)
    • Palliative Medicine (75)
    • Pathology (473)
    • Pediatrics (1115)
    • Pharmacology and Therapeutics (466)
    • Primary Care Research (452)
    • Psychiatry and Clinical Psychology (3432)
    • Public and Global Health (6527)
    • Radiology and Imaging (1403)
    • Rehabilitation Medicine and Physical Therapy (814)
    • Respiratory Medicine (871)
    • Rheumatology (409)
    • Sexual and Reproductive Health (410)
    • Sports Medicine (342)
    • Surgery (448)
    • Toxicology (53)
    • Transplantation (185)
    • Urology (165)