Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

A Deep Recurrent Reinforced Learning model to compare the efficacy of targeted local vs. national measures on the spread of COVID-19 in the UK

View ORCID ProfileTim Dong, View ORCID ProfileUmberto Benedetto, Shubhra Sinha, Arnaldo Dimagli, Massimo Caputo, Gianni D Angelini
doi: https://doi.org/10.1101/2021.05.21.20248630
Tim Dong
1Bristol Heart Institute, Bristol Medical School, University of Bristol BS2 8DZ, United Kingdom
Roles: Assistant Database Manager
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Tim Dong
Umberto Benedetto
1Bristol Heart Institute, Bristol Medical School, University of Bristol BS2 8DZ, United Kingdom
Roles: Associate Professor in Cardiac Surgery
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Umberto Benedetto
  • For correspondence: umberto.benedetto{at}bristol.ac.uk
Shubhra Sinha
1Bristol Heart Institute, Bristol Medical School, University of Bristol BS2 8DZ, United Kingdom
Roles: National Trainee Number in Cardiothoracic Surgery
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Arnaldo Dimagli
1Bristol Heart Institute, Bristol Medical School, University of Bristol BS2 8DZ, United Kingdom
Roles: Assistant Database Manager
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Massimo Caputo
1Bristol Heart Institute, Bristol Medical School, University of Bristol BS2 8DZ, United Kingdom
Roles: Professor of Congenital Heart Surgery
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gianni D Angelini
1Bristol Heart Institute, Bristol Medical School, University of Bristol BS2 8DZ, United Kingdom
Roles: BHF Professor of Cardiac Surgery
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Objectives We have developed a deep learning model that provides predictions of the COVID-19 related number of cases and mortality in the upcoming 5 weeks and simulates the effect of policy changes targeting COVID-19 spread.

Methods We developed a Deep Recurrent Reinforced Learning (DRRL) based model. The data used to train the DRRL model was based on various available datasets that have the potential to influence the trend in the number of COVID-19 cases and mortality. Analyses were performed based on the simulation of policy changes targeting COVID-19 spread, and the geographical representation of these effects.

Results Model predictions of the number of cases and mortality of COVID-19 in the upcoming 5 weeks closely matched the actual values. Local lockdown with social distancing (LD_SD) was found to be ineffective compared to national lockdown. The ranking of effectiveness of supplementary measures for LD_SD were found to be consistent across national hotspots and local areas. Measure effectiveness were ranked from most effective to least effective: 1) full lockdown; 2) LD_SD with international travel −50%; 3) LD_SD with 100% quarantine; 4) LD_SD with closing school −50%; 5) LD_SD with closing pubs −50%. There were negligible differences observed between LD_SD, LD_SD with −50% food & Accommodation and LD_SD with −50% Retail.

Conclusions The second national lockdown should be followed by measures which are more effective than LD_SD alone. Our model suggests the importance of restrictions on international travel and travel quarantines, thus suggesting that follow-up policies should consist of the combination of LD_SD and a reduction in the number of open airports within close proximity of the hotspot regions. Stricter measures should be placed in terms travel quarantine to increase the impact of this measure. It is also recommended that restrictions should be placed on the number of schools and pubs open.

Strengths and limitations of this study

  • - The proposed Deep Recurrent Reinforced Learning (DRRL)-based model takes into account of both relationships of variables across local authorities and across time, using ideas from reinforcement learning to improve predictions.

  • - Whilst, predicting the geographical trend in COVID-19 cases based on the simulation of different measures in the UK at both the national and local levels in the UK has proved challenging, this study has provided a methodology by which useful predictions and simulations can be obtained.

  • - The Office for National Statistics only released data on UK international travel up to March 2019 at the time of this study, and therefore this study used the amount of UK tourists in Spain as a reference variable for understanding the effect of international travel on COVID-19 spread.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

This study was supported by the NIHR Biomedical Research Centre at University Hospitals Bristol and Weston NHS Foundation Trust and the University of Bristol. The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. All authors had full access to all of the data (including statistical reports and tables) in the study and can take responsibility for the integrity of the data and the accuracy of the data analysis.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Approval not required

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

All the data used in the study are available from public resources. The data source are found in the Supplementary Materials document and any study results can also be made available on request from the corresponding author.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted May 22, 2021.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
A Deep Recurrent Reinforced Learning model to compare the efficacy of targeted local vs. national measures on the spread of COVID-19 in the UK
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
A Deep Recurrent Reinforced Learning model to compare the efficacy of targeted local vs. national measures on the spread of COVID-19 in the UK
Tim Dong, Umberto Benedetto, Shubhra Sinha, Arnaldo Dimagli, Massimo Caputo, Gianni D Angelini
medRxiv 2021.05.21.20248630; doi: https://doi.org/10.1101/2021.05.21.20248630
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
A Deep Recurrent Reinforced Learning model to compare the efficacy of targeted local vs. national measures on the spread of COVID-19 in the UK
Tim Dong, Umberto Benedetto, Shubhra Sinha, Arnaldo Dimagli, Massimo Caputo, Gianni D Angelini
medRxiv 2021.05.21.20248630; doi: https://doi.org/10.1101/2021.05.21.20248630

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Infectious Diseases (except HIV/AIDS)
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)