Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Predictive approaches to heterogeneous treatment effects: a systematic review

Alexandros Rekkas, Jessica K. Paulus, Gowri Raman, John B. Wong, View ORCID ProfileEwout W. Steyerberg, Peter R. Rijnbeek, View ORCID ProfileDavid M. Kent, View ORCID ProfileDavid van Klaveren
doi: https://doi.org/10.1101/19010827
Alexandros Rekkas
1Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, The Netherlands
2Department of Medical Informatics, Erasmus Medical Center, Rotterdam, The Netherlands
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jessica K. Paulus
3Predictive Analytics and Comparative Effectiveness (PACE) Center, Institute for Clinical Research and Health Policy Studies (ICRHPS), Tufts Medical Center, Boston, MA, USA
ScD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gowri Raman
4Center for Clinical Evidence Synthesis, ICRHPS, Tufts Medical Center, Boston, MA, USA
MBBS, MS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
John B. Wong
5Division of Clinical Decision Making, Tufts Medical Center, Boston, MA, USA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ewout W. Steyerberg
1Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, The Netherlands
6Department of Public Health, Erasmus Medical Center, Rotterdam, The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ewout W. Steyerberg
Peter R. Rijnbeek
2Department of Medical Informatics, Erasmus Medical Center, Rotterdam, The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David M. Kent
3Predictive Analytics and Comparative Effectiveness (PACE) Center, Institute for Clinical Research and Health Policy Studies (ICRHPS), Tufts Medical Center, Boston, MA, USA
MD, MS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for David M. Kent
  • For correspondence: dkent1{at}tuftsmedicalcenter.org
David van Klaveren
3Predictive Analytics and Comparative Effectiveness (PACE) Center, Institute for Clinical Research and Health Policy Studies (ICRHPS), Tufts Medical Center, Boston, MA, USA
6Department of Public Health, Erasmus Medical Center, Rotterdam, The Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for David van Klaveren
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Recent evidence suggests that there is often substantial variation in the benefits and harms across a trial population. We aimed to identify regression modeling approaches that assess heterogeneity of treatment effect within a randomized clinical trial.

Methods We performed a literature review using a broad search strategy, complemented by suggestions of a technical expert panel.

Results The approaches are classified into 3 categories: 1) Risk-based methods (11 papers) use only prognostic factors to define patient subgroups, relying on the mathematical dependency of the absolute risk difference on baseline risk; 2) Treatment effect modeling methods (9 papers) use both prognostic factors and treatment effect modifiers to explore characteristics that interact with the effects of therapy on a relative scale. These methods couple data-driven subgroup identification with approaches to prevent overfitting, such as penalization or use of separate data sets for subgroup identification and effect estimation. 3) Optimal treatment regime methods (12 papers) focus primarily on treatment effect modifiers to classify the trial population into those who benefit from treatment and those who do not. Finally, we also identified papers which describe model evaluation methods (4 papers).

Conclusion Three classes of approaches were identified to assess heterogeneity of treatment effect. Methodological research, including both simulations and empirical evaluations, is required to compare the available methods in different settings and to derive well-informed guidance for their application in RCT analysis.

Key messages

  • Heterogeneity of treatment effect refers to the non-random variation in the direction or magnitude of a treatment effect for individuals within a population.

  • A large number of regression-based predictive approaches to the analysis of treatment effect heterogeneity exists, which can be divided into three broad classes based on if they incorporate: prognostic factors (risk-based methods); treatment effect modifiers (optimal treatment regime methods); or both (treatment effect modeling methods).

  • Simulations and empirical evaluations are required to compare the available methods in different settings and to derive well-informed guidance for their application in RCT analysis.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

This work was supported by a Patient Centered Outcomes Research Institute (PCORI) contract, the Predictive Analytics Resource Center [SA.Tufts.PARC.OSCO.2018.01.25]. We also acknowledge support from the Innovative Medicines Initiative (IMI).

Author Declarations

All relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.

Yes

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

All data collected for systematic review is publically available on Medline and Cochrane Central.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted November 02, 2019.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Predictive approaches to heterogeneous treatment effects: a systematic review
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Predictive approaches to heterogeneous treatment effects: a systematic review
Alexandros Rekkas, Jessica K. Paulus, Gowri Raman, John B. Wong, Ewout W. Steyerberg, Peter R. Rijnbeek, David M. Kent, David van Klaveren
medRxiv 19010827; doi: https://doi.org/10.1101/19010827
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Predictive approaches to heterogeneous treatment effects: a systematic review
Alexandros Rekkas, Jessica K. Paulus, Gowri Raman, John B. Wong, Ewout W. Steyerberg, Peter R. Rijnbeek, David M. Kent, David van Klaveren
medRxiv 19010827; doi: https://doi.org/10.1101/19010827

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Epidemiology
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)