Abstract
Currently, placebo-controlled clinical trials report mean change and effect sizes, which masks information about heterogeneity of treatment effects (HTE). Here, we present a method to estimate HTE and evaluate the null hypothesis (H0) that a drug has equal benefit for all participants (HTE=0). We developed measure termed ‘estimated heterogeneity of treatment effect’ or eHTE, which estimates variability in drug response by comparing distributions between study arms. This approach was tested across numerous large placebo-controlled clinical trials. In contrast with variance-based methods which have not identified heterogeneity in psychiatric trials, reproducible instances of treatment heterogeneity were found. For example, heterogeneous response was found in a trial of venlafaxine for depression (peHTE=0.034), and two trials of dasotraline for binge eating disorder (Phase 2, peHTE=0.002; Phase 3, 4mg peHTE=0.011; Phase 3, 6mg peHTE=0.003). Significant response heterogeneity was detected in other datasets as well, often despite no difference in variance between placebo and drug arms. The implications of eHTE as a clinical trial outcomes independent from central tendency of the group is considered and the important of the eHTE method and results for drug developers, providers, and patients is discussed.
Competing Interest Statement
Authors JSS JZ ST AO STS KSK and SCH are former employees of Sumitomo Pharma America. In the past year, JSS has received consulting fees from Forbes Manhattan and Longitude Capital. In the past year, Dr. Faraone received income, potential income, travel expenses continuing education support and/or research support from Aardvark, Aardwolf, AIMH, Tris, Otsuka, Ironshore, Johnson & Johnson/Kenvue, ADHDOnline, KemPharm/Corium, Akili, Supernus, Atentiv, Noven, Sky Therapeutics, Axsome and Genomind. With his institution, he has US patent US20130217707 A1 for the use of sodium-hydrogen exchange inhibitors in the treatment of ADHD. He also receives royalties from books published by Guilford Press: Straight Talk about Your Child?s Mental Health, Oxford University Press: Schizophrenia: The Facts and Elsevier: ADHD: Non-Pharmacologic Interventions. He is Program Director of www.ADHDEvidence.org and www.ADHDinAdults.com. Dr. Faraone's research and education programs are supported by the European Union?s Horizon 2020 research and innovation programme under grant agreement 965381 NIH/NIMH grants U01AR076092-01A1, R0MH116037, 5R01AG064955-02, 1R21MH126494-01, 1R01NS128535-01, R01MH131685-01, 1R01MH130899- 01A1, Corium Pharmaceuticals, Tris Pharmaceuticals and Supernus Pharmaceutical Company.
Clinical Trial
Data are used from: NCT02564588 NCT03107026 NCT02428088 NCT01692782 NCT02276209 NCT00615433 NCT00549718 NCT00790192 NCT03429075 NCT03866174 NCT0058497
Funding Statement
Yes
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Not Applicable
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This is a meta-analysis. No data were collected as a part of this research.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Not Applicable
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Not Applicable
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Not Applicable
Data Availability
Code to compute eHTE on participant-level clinical data is available in Python, Matlab, and SAS languages at http://gitlab.com/siegelandthebrain. Some of the clinical trial data are proprietary to Sumitomo Pharma America and are available upon request.
